-- Logs begin at Mon 2022-10-24 12:31:37 UTC, end at Mon 2022-10-24 13:31:54 UTC. -- Oct 24 12:58:40.409013 dv-cinder-862489-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 24 12:58:40.417975 dv-cinder-862489-1-smb devstack@keystone.service[81624]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 24 12:58:40.420012 dv-cinder-862489-1-smb devstack@keystone.service[81624]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 12:58:40 2022] *** Oct 24 12:58:40.420012 dv-cinder-862489-1-smb devstack@keystone.service[81624]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 12:58:40.420012 dv-cinder-862489-1-smb devstack@keystone.service[81624]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 12:58:40.420012 dv-cinder-862489-1-smb devstack@keystone.service[81624]: nodename: dv-cinder-862489-1-smb Oct 24 12:58:40.420012 dv-cinder-862489-1-smb devstack@keystone.service[81624]: machine: x86_64 Oct 24 12:58:40.420012 dv-cinder-862489-1-smb devstack@keystone.service[81624]: clock source: unix Oct 24 12:58:40.420012 dv-cinder-862489-1-smb devstack@keystone.service[81624]: pcre jit disabled Oct 24 12:58:40.420012 dv-cinder-862489-1-smb devstack@keystone.service[81624]: detected number of CPU cores: 4 Oct 24 12:58:40.420012 dv-cinder-862489-1-smb devstack@keystone.service[81624]: current working directory: / Oct 24 12:58:40.420012 dv-cinder-862489-1-smb devstack@keystone.service[81624]: detected binary path: /usr/bin/uwsgi-core Oct 24 12:58:40.420770 dv-cinder-862489-1-smb devstack@keystone.service[81624]: your processes number limit is 47680 Oct 24 12:58:40.420770 dv-cinder-862489-1-smb devstack@keystone.service[81624]: your memory page size is 4096 bytes Oct 24 12:58:40.420770 dv-cinder-862489-1-smb devstack@keystone.service[81624]: detected max file descriptor number: 2048 Oct 24 12:58:40.420770 dv-cinder-862489-1-smb devstack@keystone.service[81624]: lock engine: pthread robust mutexes Oct 24 12:58:40.420770 dv-cinder-862489-1-smb devstack@keystone.service[81624]: thunder lock: enabled Oct 24 12:58:40.420770 dv-cinder-862489-1-smb devstack@keystone.service[81624]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 24 12:58:40.420770 dv-cinder-862489-1-smb devstack@keystone.service[81624]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 12:58:40.458998 dv-cinder-862489-1-smb devstack@keystone.service[81624]: Python main interpreter initialized at 0x5603673a59c0 Oct 24 12:58:40.458998 dv-cinder-862489-1-smb devstack@keystone.service[81624]: python threads support enabled Oct 24 12:58:40.458998 dv-cinder-862489-1-smb devstack@keystone.service[81624]: your server socket listen backlog is limited to 100 connections Oct 24 12:58:40.458998 dv-cinder-862489-1-smb devstack@keystone.service[81624]: your mercy for graceful operations on workers is 90 seconds Oct 24 12:58:40.459349 dv-cinder-862489-1-smb devstack@keystone.service[81624]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 12:58:40.459424 dv-cinder-862489-1-smb devstack@keystone.service[81624]: *** Operational MODE: preforking *** Oct 24 12:58:40.459681 dv-cinder-862489-1-smb devstack@keystone.service[81624]: *** uWSGI is running in multiple interpreter mode *** Oct 24 12:58:40.459681 dv-cinder-862489-1-smb devstack@keystone.service[81624]: spawned uWSGI master process (pid: 81624) Oct 24 12:58:40.459886 dv-cinder-862489-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 24 12:58:40.460826 dv-cinder-862489-1-smb devstack@keystone.service[81624]: spawned uWSGI worker 1 (pid: 81636, cores: 1) Oct 24 12:58:40.461158 dv-cinder-862489-1-smb devstack@keystone.service[81624]: spawned uWSGI worker 2 (pid: 81637, cores: 1) Oct 24 12:58:40.461418 dv-cinder-862489-1-smb devstack@keystone.service[81624]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 12:58:44.688380 dv-cinder-862489-1-smb devstack@keystone.service[81636]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 12:58:44.688380 dv-cinder-862489-1-smb devstack@keystone.service[81636]: from cryptography.utils import int_from_bytes Oct 24 12:58:44.689226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 12:58:44.689226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: from cryptography.utils import int_from_bytes Oct 24 12:58:44.689638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 12:58:44.689638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: from cryptography.utils import int_from_bytes Oct 24 12:58:44.689746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 12:58:44.689746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: from cryptography.utils import int_from_bytes Oct 24 12:58:44.738338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 12:58:44.738517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 12:58:44.738517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 12:58:44.738666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 12:58:44.738730 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] command line args: [] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 12:58:44.738787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] command line args: [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 12:58:44.738928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 12:58:44.739016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 12:58:44.739150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ================================================================================ {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 12:58:44.739275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ================================================================================ {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 12:58:44.739363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] admin_token = **** {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.739441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] admin_token = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.739637 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] config_dir = [] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.739768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] config_dir = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.739768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.739895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.739958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] config_source = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.740016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] config_source = [] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.740155 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] debug = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.740331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] debug = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.740331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.741749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.741749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.741905 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.741965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742205 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742327 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] list_limit = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] log_config_append = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] log_config_append = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] log_dir = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] log_dir = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] log_file = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] log_file = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.742945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.743862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.744001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.744083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.744150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.744328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.744424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.744555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.744658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.744778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.744863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.745025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.745102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.745263 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.745359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.745543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.745680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.746040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.746131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.746216 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] publish_errors = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.746291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] publish_errors = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.746430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.746515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.746650 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.747051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.747150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.747247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.747393 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.747492 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.747622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.747696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.747852 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] standard_threads = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.747939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] standard_threads = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.748075 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.748158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.748329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.748408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.748508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.748582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.748664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] use_journal = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.748784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] use_journal = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.748852 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] use_json = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.748911 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] use_json = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.749055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] use_stderr = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.749153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] use_stderr = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.749225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] use_syslog = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.749305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] use_syslog = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.749399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.749484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 12:58:44.749648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.749723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.749883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.749966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.750142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.750223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.750380 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.750456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.750630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.750763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.750893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.751013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.751138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.751258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.751383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.751478 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.751556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.751636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.751783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.751865 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.752031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.752114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.752261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.752350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.752535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.752621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.752770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.752854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.753017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.753092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.753263 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.753338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.753497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.753579 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.753748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.753828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.753998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.754079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.754240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.754392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.754472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.754541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.754766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.754851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.755026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.755107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.755276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.755357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.755523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.755599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.755756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.755831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.755986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.756060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.756213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.756324 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.756470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.756547 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.756720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.756801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.756969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.757049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.757200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.757277 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.757430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.757503 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.757673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.757748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.757916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.757992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.758152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.758227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.758395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.758469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.758623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.758699 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.758855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.758937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.759089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.759164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.759318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.759394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.759544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.759619 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.759772 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.759846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.759992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.760069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.760217 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.760312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.760488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.760564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.760717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.760800 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.760951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.761030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.761177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.761252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.761409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.761485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.761640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.761714 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.761884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.761959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.762110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.762186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.762344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.762419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.762578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.762658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.762813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.762887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.763045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.763152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.763267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.763371 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.763495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.763603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.763738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.763839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.763970 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.764078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.764204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.764280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.764459 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.764552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.764716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.764841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.764977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.765073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.765177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.765254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.765413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.765491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.765645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.765766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.765909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.765985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.766144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.766221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.766388 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.766472 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.766631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.766713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.766865 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.766950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.767098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.767222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.767333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.767410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.767574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.767649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.767810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.767893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.768045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.768129 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.768284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.768390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.768542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.768633 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.768787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.768870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.769025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.769102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.769256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.769339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.769491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.769566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.769722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.769796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.769953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.770053 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.770237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.770320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.770477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.770552 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.770724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.770807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.770961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.771037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.771195 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.771275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.771433 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.771586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.771661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.771729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.771890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.771967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.772124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.772211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.772376 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.772454 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.772606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.772692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.772832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.772907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.773063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.773139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.773291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.773365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.773525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.773600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.773757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.773834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.774003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.774078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.774235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.774310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.774486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.774562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.774743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.774819 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.774981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.775087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.775213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.external = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.775291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] auth.external = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.775440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.775517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.775731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.775809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.775961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.776054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.776188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.password = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.776269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] auth.password = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.776442 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] auth.token = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.776519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.token = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.776679 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.776757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.776912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.776989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.777157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.777234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.777386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.777462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.777629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.777707 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.777873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.777949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.778100 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.778176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.778331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.778407 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] credential.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.778576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.778652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.778820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.778895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.779066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.779147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.779307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.779384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.779547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.779623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.779777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.779853 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.780019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.780101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.780269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.780422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.780509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.780581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.780763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.780841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.781045 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.781122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.781285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.781362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.781544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.781620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.781783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.781859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.782034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.782113 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.782265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.782344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] federation.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.782502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.782578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.782743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.782820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.782987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.783063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.783218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.783294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.783461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.783539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.783696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.783773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.783947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.784031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.784181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.784258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.784457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.784535 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.784694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.784778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.784941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.785017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.785173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.785255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.785419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.785573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.785648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.785718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.785937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.786015 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.786177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.786261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.786424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.786501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.786653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.786729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.786887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.786972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.787137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.787215 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.787386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.787462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.787614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.787698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.787844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.787920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.788069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.788145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.788325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.788416 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.788575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.788651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.788819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.788895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.789074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.789163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.789319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.789470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.789586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.789663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.789822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.789907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.790060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.790135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.790288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.790364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.790525 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.790610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.790754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.790830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.790987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.791062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.791223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.791307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.791462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.791541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.791708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.791784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.791936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.792020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.792181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.792257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.792448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.792524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.792683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.792772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.792927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.793003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.793169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.793245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.793396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.793473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.793631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.793707 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.793858 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.793933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.794094 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.794171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.794328 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.794403 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.794565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.794641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.794800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.794877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.795139 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.795216 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.795389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.795465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.795637 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.795714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.795866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.795941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.796096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.796171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.796371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.796453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.796619 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.796698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.796854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.796941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.797091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.797169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.797326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.797409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.797556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.797632 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.797793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.797870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.798047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.798123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.798276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.798352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.798522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.798600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.798766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.798842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.799010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.799087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.799244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.799321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.799471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.799548 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.799705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.799782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.799937 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.800014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.800171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.800247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.800422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.800499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.800669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.800747 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.800910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.800987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.801153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.801229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.801394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.801501 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.801691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.801768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.801920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.802002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.802163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.802503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.802503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.802629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.802699 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.802771 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.802848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.802920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.803067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.803146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.803310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.803386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.803554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.803631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.803788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.803864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.804037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.804118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.804265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.804406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.804529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.804605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.804762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.804839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.804993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.805070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.805227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.805303 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.805470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.805545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.805709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.805786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.805937 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.806013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.806168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.806245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.806404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.806481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] resource.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.806651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.806727 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.806894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.806970 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.807127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.807204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.807371 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.807447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.807617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.807693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.807849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.807927 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.808093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.808169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.808351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.808505 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.808580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.808650 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.808811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] role.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.808889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] role.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.809056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] role.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.809142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] role.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.809284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.809360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.809530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.809606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.809774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.809859 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.810017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.810093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.810258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.810335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.810497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.810582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.810738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.810818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.810980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.811057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.811223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.811308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.811451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.811528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.811693 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.811769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.811934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.812018 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.812177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.812254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.812444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.812521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.812827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.812915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.813060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.813137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.813303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.813380 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.813548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.813634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.813793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.813869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.814036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.814112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.814268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.814345 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.814518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.814594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.814767 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.814843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.815002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.815078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.815228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.815304 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.815456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.815532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.815684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.815762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.815932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.816014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.816183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.816260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.816454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.816533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.816692 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.816769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.816926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.817002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.817178 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.817256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.817414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] token.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.817490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] token.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.817651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.817727 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.817894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.817971 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.818129 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.818205 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.818381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.818463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.818625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.818702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.818858 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.818941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.819103 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.819184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.819343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.819422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.819586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.819663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.819822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.819899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.820055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.820133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.820287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.820439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.820554 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.820632 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.820823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.820901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.821051 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.821136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.821293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.821378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.821553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.821629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.821807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.connection = **** {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.821892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.connection = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.822048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.822125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.822293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.822376 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.822529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.822614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.822768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.822850 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.823001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.823167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.823245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.823324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.823457 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.823535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.823692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.823768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.823935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.824020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.824170 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.824247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.824436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.824516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.824670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.824759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.824914 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.824991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.825145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.825224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.825386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.825471 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.825613 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.825689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.825847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.825923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.826078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.826163 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 12:58:44.826235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 12:58:44.826305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 12:58:44.855732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.855948 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.856197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.858447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.858839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.859238 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.864916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.871659 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.893217 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.893481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.897793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.898022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.946030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.946598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.994011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.994256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.994399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:44.994662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.152213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.152444 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.152518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.152585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.152677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.152756 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.152852 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.152930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.153081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.153212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.153307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.153374 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.175879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.176005 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.176075 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.176268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.176409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.176573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.176655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.176795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.176942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.177016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.177093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.177234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.177327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.177402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.188215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.188580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.200970 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.201103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.201352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.201489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.201561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.201638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.201776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.201901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.201991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.202075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.202138 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.202298 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.202521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.202738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 12:58:45.218833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.219064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 12:58:45.219334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.219461 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.219540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 12:58:45.219636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 12:58:45.219847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.219968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.220048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 12:58:45.220111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.220321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.220444 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.220604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.220773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.220862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.221110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.230762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.231044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.231315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.231598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.231795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.232078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.232350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.232654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.238595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.239627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.241540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.241828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.242112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.242391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.242558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.242653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.242865 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.242989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.243148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.243272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.243404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.243496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.243680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.243867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.243957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.244031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.244212 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.244363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.244518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.244791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.245065 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.245317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.267035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.268104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.268519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.268806 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.269588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.269878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.273468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.273760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.274037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.274550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.274834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.275126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.280325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.280651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.281476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.281769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.286299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.286593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.286882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.287177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.287455 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.287649 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.287744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.287887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.287968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.288085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.288230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.288334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.288597 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.288878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.289158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.289426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.303489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.303770 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.304720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.305002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.307570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.308794 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.310839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.311139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.311963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.312265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.315252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.316418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.318455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.319574 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.321680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.321982 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.322275 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.322569 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.322811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.322944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.323115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.323242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.323397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.323697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.323991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.324266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.338758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.339050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.339319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.339582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.339899 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.340188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.340488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.340755 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.346375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.347547 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.347920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.349171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.349587 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.349875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.350718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.351037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.352525 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.352810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.353094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.353386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.353719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.353865 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.353985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.354286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.354569 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.354958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.364874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.365161 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.365446 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.365723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.366077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.366224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.366337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.366424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.366652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.366777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.366939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.367334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.367619 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.367886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.382594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.383556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.385506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.386488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.388428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.389386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.389927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.390832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.391402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.391686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.392090 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.392325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.392621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.393026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.398450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.399321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.399924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.400822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.402800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.403200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.403482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.403690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.403816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.404089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.404398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.404679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.411571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.411863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.412142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.412515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.412811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.413091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.419006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.419293 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.419577 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.419860 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.419988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 12:58:45.420140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.420281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.420391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.420470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.420691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.420820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.420984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.421124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.421204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.421287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.421505 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.421700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.421837 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.421960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.422081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.422201 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.422349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.422477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.422601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.422726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.422852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.423070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.423342 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 12:58:45.456106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5603673a59c0 pid: 81637 (default app) Oct 24 12:58:45.456854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5603673a59c0 pid: 81636 (default app) Oct 24 12:58:45.459444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1d0d7-540d-47ab-bc5e-2c16042b8a57 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:45.459734 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1d0d7-540d-47ab-bc5e-2c16042b8a57 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:45.460006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1d0d7-540d-47ab-bc5e-2c16042b8a57 None None] PATH_INFO: `/v3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:45.464190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Mon Oct 24 12:58:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:58:52.230484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9011c-eac7-45b3-be17-d503875b2e63 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:52.231267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9011c-eac7-45b3-be17-d503875b2e63 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:52.231487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9011c-eac7-45b3-be17-d503875b2e63 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:52.238715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:58:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:58:52.247910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:52.248380 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:52.248522 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:52.321405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: INFO dbcounter [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] Registered counter for database keystone Oct 24 12:58:52.342640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG oslo_db.sqlalchemy.engines [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 12:58:52.354309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writer thread running {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 12:58:52.539532 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG passlib.handlers.bcrypt [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81637) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 24 12:58:52.539820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG passlib.handlers.bcrypt [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81637) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 24 12:58:52.599099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:58:52.600727 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:58:52.731304 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:58:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 12:58:53.219220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9011c-eac7-45b3-be17-d503875b2e63 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:53.296180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: INFO dbcounter [None req-8df9011c-eac7-45b3-be17-d503875b2e63 None None] Registered counter for database keystone Oct 24 12:58:53.320963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG oslo_db.sqlalchemy.engines [None req-8df9011c-eac7-45b3-be17-d503875b2e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 12:58:53.332704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writer thread running {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 12:58:53.453579 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9011c-eac7-45b3-be17-d503875b2e63 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:53.462822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e4355-e0de-4eee-8454-98481558caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:53.463822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e4355-e0de-4eee-8454-98481558caa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:53.464281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e4355-e0de-4eee-8454-98481558caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:53.464796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e4355-e0de-4eee-8454-98481558caa7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:53.478405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e4355-e0de-4eee-8454-98481558caa7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:53.530136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4d0e4355-e0de-4eee-8454-98481558caa7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 24 12:58:53.530483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e4355-e0de-4eee-8454-98481558caa7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:53.541025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Oct 24 12:58:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 12:58:53.547365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:53.567467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbedf3e-08bf-4c67-9ccc-ef16cb64db16 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:53.572324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c648a-6478-4d68-81da-b7caee6efa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:53.573461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c648a-6478-4d68-81da-b7caee6efa59 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:53.573741 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c648a-6478-4d68-81da-b7caee6efa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:53.574009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c648a-6478-4d68-81da-b7caee6efa59 admin admin] PATH_INFO: `/v3/projects/137e4bed4da241048e2ccc51fb5ebefa` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:53.575643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c648a-6478-4d68-81da-b7caee6efa59 admin admin] RBAC: Authorizing `identity:get_project(project_id=137e4bed4da241048e2ccc51fb5ebefa)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:53.628125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a17c648a-6478-4d68-81da-b7caee6efa59 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 24 12:58:53.628482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c648a-6478-4d68-81da-b7caee6efa59 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:53.633136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Oct 24 12:58:53 2022] GET /identity/v3/projects/137e4bed4da241048e2ccc51fb5ebefa => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:58:55.748081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3961c-dd9c-4b4c-8568-905b03d53faa None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:55.749048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3961c-dd9c-4b4c-8568-905b03d53faa None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:55.749048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3961c-dd9c-4b4c-8568-905b03d53faa None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:55.755533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:58:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:58:55.761378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eca9bb-496b-4773-9761-8908e1c8e8b3 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:55.761836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eca9bb-496b-4773-9761-8908e1c8e8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:55.761928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eca9bb-496b-4773-9761-8908e1c8e8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:55.783678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-81eca9bb-496b-4773-9761-8908e1c8e8b3 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:58:55.785218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-81eca9bb-496b-4773-9761-8908e1c8e8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:58:55.793737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:58:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 24 12:58:56.052537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3961c-dd9c-4b4c-8568-905b03d53faa None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:56.066802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3961c-dd9c-4b4c-8568-905b03d53faa None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:56.072269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c9b95-dfe7-4fec-8022-89d2856308db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:56.072943 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c9b95-dfe7-4fec-8022-89d2856308db admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:56.073217 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c9b95-dfe7-4fec-8022-89d2856308db admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:56.073485 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c9b95-dfe7-4fec-8022-89d2856308db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:56.081965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c9b95-dfe7-4fec-8022-89d2856308db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:56.083865 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c9b95-dfe7-4fec-8022-89d2856308db admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:56.092534 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Oct 24 12:58:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 12:58:56.097826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eca9bb-496b-4773-9761-8908e1c8e8b3 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:56.107403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eca9bb-496b-4773-9761-8908e1c8e8b3 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:56.113452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cc1ef-adfe-4a3a-9882-ae6e818a8e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:56.114112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cc1ef-adfe-4a3a-9882-ae6e818a8e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:56.114468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cc1ef-adfe-4a3a-9882-ae6e818a8e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:56.114736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cc1ef-adfe-4a3a-9882-ae6e818a8e22 admin admin] PATH_INFO: `/v3/users/7a57e5ee78334c3d8abcf656f9c79512` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:56.116199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cc1ef-adfe-4a3a-9882-ae6e818a8e22 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a57e5ee78334c3d8abcf656f9c79512)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:56.118066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cc1ef-adfe-4a3a-9882-ae6e818a8e22 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:56.119610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Oct 24 12:58:56 2022] GET /identity/v3/users/7a57e5ee78334c3d8abcf656f9c79512 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:58:58.278876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce431a5-9f6b-40f9-b51a-77af392fc0a0 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:58.279430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce431a5-9f6b-40f9-b51a-77af392fc0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:58.279430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce431a5-9f6b-40f9-b51a-77af392fc0a0 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:58.280881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:58:58.286185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0321b-38f9-42e7-bc75-6964d2de2c26 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:58.286618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0321b-38f9-42e7-bc75-6964d2de2c26 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:58.286710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0321b-38f9-42e7-bc75-6964d2de2c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:58.305880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2cf0321b-38f9-42e7-bc75-6964d2de2c26 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:58:58.307074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2cf0321b-38f9-42e7-bc75-6964d2de2c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:58:58.345227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b73a2-b3c3-4ab7-aeca-4414c0de870e None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:58.345511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b73a2-b3c3-4ab7-aeca-4414c0de870e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:58.345786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b73a2-b3c3-4ab7-aeca-4414c0de870e None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:58.347126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:58:58.352700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d1d3-56d0-430a-b0fe-d3c1d14b81c3 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:58.352987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d1d3-56d0-430a-b0fe-d3c1d14b81c3 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:58.353259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d1d3-56d0-430a-b0fe-d3c1d14b81c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:58.396545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:58:58.398321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG passlib.handlers.bcrypt [None req-5d25d1d3-56d0-430a-b0fe-d3c1d14b81c3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81636) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 24 12:58:58.398728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG passlib.handlers.bcrypt [None req-5d25d1d3-56d0-430a-b0fe-d3c1d14b81c3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81636) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 24 12:58:58.448681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5d25d1d3-56d0-430a-b0fe-d3c1d14b81c3 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:58:58.450288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5d25d1d3-56d0-430a-b0fe-d3c1d14b81c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:58:58.551438 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:58:58.661411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0321b-38f9-42e7-bc75-6964d2de2c26 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:58.686150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:58:58.767984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0321b-38f9-42e7-bc75-6964d2de2c26 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:58.802239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ed72-aa76-4dc6-a5b6-30da461d3089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:58.802807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ed72-aa76-4dc6-a5b6-30da461d3089 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:58.803083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ed72-aa76-4dc6-a5b6-30da461d3089 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:58.803357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ed72-aa76-4dc6-a5b6-30da461d3089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:58.812990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d1d3-56d0-430a-b0fe-d3c1d14b81c3 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:58.817667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9ed72-aa76-4dc6-a5b6-30da461d3089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-08c9ed72-aa76-4dc6-a5b6-30da461d3089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:58:58.826562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:58:58.827565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:58:58.828431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 12:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:58:58.833492 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ed72-aa76-4dc6-a5b6-30da461d3089 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:58.915701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:58:58.919088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d1d3-56d0-430a-b0fe-d3c1d14b81c3 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:58.921358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:58:58.935087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ed72-aa76-4dc6-a5b6-30da461d3089 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:58.955476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c70f82-1ca4-4f36-8887-f841ead4e490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:58.956421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c70f82-1ca4-4f36-8887-f841ead4e490 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:58.956702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c70f82-1ca4-4f36-8887-f841ead4e490 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:58.956968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c70f82-1ca4-4f36-8887-f841ead4e490 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:58.957939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c70f82-1ca4-4f36-8887-f841ead4e490 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:58.959372 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c70f82-1ca4-4f36-8887-f841ead4e490 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:58.971234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598868d8-2917-4999-8b37-e00491ebbf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:58.971396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.sql.core [None req-c0c70f82-1ca4-4f36-8887-f841ead4e490 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 12:58:58.971396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 12:58:58.971396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [parameters: {'id': 'f4fc7ae59e9f4e7c989a52309c83281a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 12:58:58.971396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81636) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 12:58:58.971859 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598868d8-2917-4999-8b37-e00491ebbf78 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:58.972136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598868d8-2917-4999-8b37-e00491ebbf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:58.972441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598868d8-2917-4999-8b37-e00491ebbf78 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:58.973122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598868d8-2917-4999-8b37-e00491ebbf78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:58:58.973457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598868d8-2917-4999-8b37-e00491ebbf78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:58.974911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598868d8-2917-4999-8b37-e00491ebbf78 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:58.986700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-c0c70f82-1ca4-4f36-8887-f841ead4e490 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application conn.query(q) Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 12:58:58.990333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result.read() Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 12:58:58.991273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application next(self.gen) Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application yield resource Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application next(self.gen) Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise self.value Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application session.commit() Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 12:58:58.992218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.session.flush() Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application compat.raise_( Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 12:58:58.993089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 12:58:58.994031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application conn.query(q) Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result.read() Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 12:58:58.994786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [parameters: {'id': 'f4fc7ae59e9f4e7c989a52309c83281a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 12:58:58.995606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:58:58.998141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:58:58.999275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 8/16] 10.222.0.15 () {60 vars in 1137 bytes} [Mon Oct 24 12:58:58 2022] POST /identity/v3/domains => generated 190 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:58:59.000076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598868d8-2917-4999-8b37-e00491ebbf78 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:59.000156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c70f82-1ca4-4f36-8887-f841ead4e490 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:59.094054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598868d8-2917-4999-8b37-e00491ebbf78 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:59.101574 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c70f82-1ca4-4f36-8887-f841ead4e490 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:59.129649 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b871983-71b5-4861-8289-22dbcc51f371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:59.130410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b871983-71b5-4861-8289-22dbcc51f371 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:59.130774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b871983-71b5-4861-8289-22dbcc51f371 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:59.131094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b871983-71b5-4861-8289-22dbcc51f371 None admin] PATH_INFO: `/v3/users/7a57e5ee78334c3d8abcf656f9c79512` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:59.132254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b871983-71b5-4861-8289-22dbcc51f371 None admin] RBAC: Authorizing `identity:get_user(user_id=7a57e5ee78334c3d8abcf656f9c79512)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:59.133743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b871983-71b5-4861-8289-22dbcc51f371 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:59.135326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:58:58 2022] GET /identity/v3/users/7a57e5ee78334c3d8abcf656f9c79512 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:58:59.135827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a954a2-06eb-4266-b0b0-436eb74297bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:59.136737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a954a2-06eb-4266-b0b0-436eb74297bb None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:59.137013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a954a2-06eb-4266-b0b0-436eb74297bb None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:59.137278 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a954a2-06eb-4266-b0b0-436eb74297bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:59.140924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b871983-71b5-4861-8289-22dbcc51f371 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:59.155232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a954a2-06eb-4266-b0b0-436eb74297bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:59.155401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:58:59.156987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a954a2-06eb-4266-b0b0-436eb74297bb None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-05a954a2-06eb-4266-b0b0-436eb74297bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 12:58:59.173166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:58:59.174119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 12:58:59.174950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 12:58:59.174950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:58:59.174950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:58:59.174950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 12:58:59.180152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a954a2-06eb-4266-b0b0-436eb74297bb None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:59.201019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:58:59.240923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b871983-71b5-4861-8289-22dbcc51f371 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:59.275935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf600e-c301-493c-bb5d-afc5680b2f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:59.276604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf600e-c301-493c-bb5d-afc5680b2f5a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:59.276893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf600e-c301-493c-bb5d-afc5680b2f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:59.277171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf600e-c301-493c-bb5d-afc5680b2f5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:59.278312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf600e-c301-493c-bb5d-afc5680b2f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:59.279789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf600e-c301-493c-bb5d-afc5680b2f5a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:59.280611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a954a2-06eb-4266-b0b0-436eb74297bb None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:59.281629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:58:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:58:59.286988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf600e-c301-493c-bb5d-afc5680b2f5a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:58:59.319449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01989bb4-8bc9-45cd-bf84-ac3a110c5918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:59.320062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01989bb4-8bc9-45cd-bf84-ac3a110c5918 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:59.320365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01989bb4-8bc9-45cd-bf84-ac3a110c5918 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:59.320661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01989bb4-8bc9-45cd-bf84-ac3a110c5918 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:59.321305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01989bb4-8bc9-45cd-bf84-ac3a110c5918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:58:59.321603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01989bb4-8bc9-45cd-bf84-ac3a110c5918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:59.323016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01989bb4-8bc9-45cd-bf84-ac3a110c5918 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:59.339892 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 12:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:58:59.375268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:58:59.397774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf600e-c301-493c-bb5d-afc5680b2f5a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:58:59.435953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c66df8-a405-4d69-beca-b9a47a905a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:58:59.436663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c66df8-a405-4d69-beca-b9a47a905a70 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:58:59.436947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c66df8-a405-4d69-beca-b9a47a905a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:58:59.437222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c66df8-a405-4d69-beca-b9a47a905a70 None admin] PATH_INFO: `/v3/domains/default/users/7a57e5ee78334c3d8abcf656f9c79512/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:58:59.439296 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c66df8-a405-4d69-beca-b9a47a905a70 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7a57e5ee78334c3d8abcf656f9c79512, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:58:59.440790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c66df8-a405-4d69-beca-b9a47a905a70 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:58:59.557906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 11/21] 10.222.0.15 () {58 vars in 1361 bytes} [Mon Oct 24 12:58:59 2022] PUT /identity/v3/domains/default/users/7a57e5ee78334c3d8abcf656f9c79512/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:01.876712 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc94ad2-df50-4136-979f-0afc09894682 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:01.877230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc94ad2-df50-4136-979f-0afc09894682 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:01.877230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc94ad2-df50-4136-979f-0afc09894682 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:01.878585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:01.893546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961429-b26a-4fae-b40d-327815f96833 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:01.894004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961429-b26a-4fae-b40d-327815f96833 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:01.894196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961429-b26a-4fae-b40d-327815f96833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:01.926286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b7961429-b26a-4fae-b40d-327815f96833 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:01.927966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b7961429-b26a-4fae-b40d-327815f96833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:02.026185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:02.053650 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82994bc-52e4-4778-a188-d067efc29f17 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:02.053979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82994bc-52e4-4778-a188-d067efc29f17 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:02.054201 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82994bc-52e4-4778-a188-d067efc29f17 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:02.055608 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:02.070414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa2230-17cb-4b9a-973b-eb750421a246 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:02.070720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa2230-17cb-4b9a-973b-eb750421a246 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:02.070979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa2230-17cb-4b9a-973b-eb750421a246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:02.097200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-deaa2230-17cb-4b9a-973b-eb750421a246 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:02.098468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-deaa2230-17cb-4b9a-973b-eb750421a246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:02.185742 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:02.190856 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:02.278740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818dc3a-5864-4315-9d10-ec9065ea0ff4 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:02.279054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818dc3a-5864-4315-9d10-ec9065ea0ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:02.279285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818dc3a-5864-4315-9d10-ec9065ea0ff4 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:02.280911 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 13/26] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:02.285728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdcc6a-7179-42f3-be21-820c488d5567 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:02.286061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdcc6a-7179-42f3-be21-820c488d5567 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:02.286346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdcc6a-7179-42f3-be21-820c488d5567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:02.309272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d8bdcc6a-7179-42f3-be21-820c488d5567 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:02.310544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d8bdcc6a-7179-42f3-be21-820c488d5567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:02.391680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 14/27] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:02.394467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818dc3a-5864-4315-9d10-ec9065ea0ff4 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:02.507707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:02.532040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818dc3a-5864-4315-9d10-ec9065ea0ff4 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:02.555899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdcc6a-7179-42f3-be21-820c488d5567 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:02.579058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d478c-cded-4451-9409-4bdc09f52357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:02.579827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d478c-cded-4451-9409-4bdc09f52357 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:02.580052 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d478c-cded-4451-9409-4bdc09f52357 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:02.580363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d478c-cded-4451-9409-4bdc09f52357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:02.596929 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d478c-cded-4451-9409-4bdc09f52357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:02.598707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d478c-cded-4451-9409-4bdc09f52357 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-8e3d478c-cded-4451-9409-4bdc09f52357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 12:59:02.626182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:02.627087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 12:59:02.627923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 12:59:02.627923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:02.627923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:02.630589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 14/28] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:02.636730 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d478c-cded-4451-9409-4bdc09f52357 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:02.696591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdcc6a-7179-42f3-be21-820c488d5567 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:02.753415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:02.761462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b03ab-f310-4102-b2a4-10f9d00450d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:02.762097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b03ab-f310-4102-b2a4-10f9d00450d0 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:02.762381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b03ab-f310-4102-b2a4-10f9d00450d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:02.762656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b03ab-f310-4102-b2a4-10f9d00450d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:02.763352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b03ab-f310-4102-b2a4-10f9d00450d0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:02.764991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b03ab-f310-4102-b2a4-10f9d00450d0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:02.798540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 15/29] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Oct 24 12:59:02 2022] POST /identity/v3/roles => generated 219 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 12:59:02.799931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a31c4-ed0d-41f3-b50e-7b9f5f06a9c9 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:02.800219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a31c4-ed0d-41f3-b50e-7b9f5f06a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:02.800644 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a31c4-ed0d-41f3-b50e-7b9f5f06a9c9 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:02.802294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:02.803998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d478c-cded-4451-9409-4bdc09f52357 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:02.812403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3438-ba79-4fee-a29f-9449586ee739 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:02.813014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3438-ba79-4fee-a29f-9449586ee739 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:02.813520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3438-ba79-4fee-a29f-9449586ee739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:02.841115 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-adaf3438-ba79-4fee-a29f-9449586ee739 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:02.842316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-adaf3438-ba79-4fee-a29f-9449586ee739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:02.869790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:02.877440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b4118-caf9-4f38-b744-fe3ef22dbcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:02.878920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b4118-caf9-4f38-b744-fe3ef22dbcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:02.879390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b4118-caf9-4f38-b744-fe3ef22dbcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:02.879918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b4118-caf9-4f38-b744-fe3ef22dbcc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:02.881041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b4118-caf9-4f38-b744-fe3ef22dbcc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:02.881552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b4118-caf9-4f38-b744-fe3ef22dbcc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:02.883757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b4118-caf9-4f38-b744-fe3ef22dbcc0 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:02.898979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 15/31] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 12:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:02.900410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b4118-caf9-4f38-b744-fe3ef22dbcc0 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:02.993444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 17/32] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:02.997512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf3438-ba79-4fee-a29f-9449586ee739 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:03.014414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b4118-caf9-4f38-b744-fe3ef22dbcc0 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:03.053240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcb79b-d303-43e1-b83f-d40509380216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:03.054237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb79b-d303-43e1-b83f-d40509380216 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:03.055270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb79b-d303-43e1-b83f-d40509380216 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:03.055881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb79b-d303-43e1-b83f-d40509380216 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:03.057894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcb79b-d303-43e1-b83f-d40509380216 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:03.059486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcb79b-d303-43e1-b83f-d40509380216 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:03.155105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf3438-ba79-4fee-a29f-9449586ee739 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:03.183234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:03.203119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c25d0-3b1e-449e-9482-bf7c8766e814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:03.204058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c25d0-3b1e-449e-9482-bf7c8766e814 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:03.204631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c25d0-3b1e-449e-9482-bf7c8766e814 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:03.205117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c25d0-3b1e-449e-9482-bf7c8766e814 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:03.205952 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c25d0-3b1e-449e-9482-bf7c8766e814 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:03.207590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c25d0-3b1e-449e-9482-bf7c8766e814 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:03.228097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 16/33] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Oct 24 12:59:02 2022] POST /identity/v3/roles => generated 225 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:03.249870 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 18/34] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 12:59:02 2022] POST /identity/v3/projects => generated 301 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:03.438531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcb79b-d303-43e1-b83f-d40509380216 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:03.507085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:03.562993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcb79b-d303-43e1-b83f-d40509380216 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:03.566510 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785db531-6159-42e5-a371-f7bf1e087ee3 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:03.566796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785db531-6159-42e5-a371-f7bf1e087ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:03.567070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785db531-6159-42e5-a371-f7bf1e087ee3 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:03.568787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 19/35] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:03.577720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6191d-e365-430b-803b-bb9ee6cdca79 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:03.578014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6191d-e365-430b-803b-bb9ee6cdca79 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:03.578336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6191d-e365-430b-803b-bb9ee6cdca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:03.604500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11459e-843e-43cc-8c94-62a5ef350269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:03.605157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11459e-843e-43cc-8c94-62a5ef350269 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:03.605257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ece6191d-e365-430b-803b-bb9ee6cdca79 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:03.605424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11459e-843e-43cc-8c94-62a5ef350269 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:03.605695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11459e-843e-43cc-8c94-62a5ef350269 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:03.606351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ece6191d-e365-430b-803b-bb9ee6cdca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:03.625701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11459e-843e-43cc-8c94-62a5ef350269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-3d11459e-843e-43cc-8c94-62a5ef350269 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:03.632870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:03.633726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:03.634493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:03.637694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 17/36] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 12:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:03.642560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11459e-843e-43cc-8c94-62a5ef350269 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:03.692700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 20/37] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:03.747706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11459e-843e-43cc-8c94-62a5ef350269 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:03.760931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:03.784143 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01a516-3528-4ed8-adce-63392ee7d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:03.784829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a516-3528-4ed8-adce-63392ee7d05a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:03.785105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a516-3528-4ed8-adce-63392ee7d05a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:03.785381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a516-3528-4ed8-adce-63392ee7d05a None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:03.786135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01a516-3528-4ed8-adce-63392ee7d05a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:03.786441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01a516-3528-4ed8-adce-63392ee7d05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:03.788047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01a516-3528-4ed8-adce-63392ee7d05a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:03.802278 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 18/38] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:03.808236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6191d-e365-430b-803b-bb9ee6cdca79 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:03.909376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be371a-25b6-4e4f-a290-1db095bb56f4 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:03.909894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be371a-25b6-4e4f-a290-1db095bb56f4 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:03.910002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be371a-25b6-4e4f-a290-1db095bb56f4 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:03.911320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 19/39] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:03.916268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1279a-71c6-46a3-b3f2-a36bcc8b1df4 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:03.916602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1279a-71c6-46a3-b3f2-a36bcc8b1df4 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:03.916877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1279a-71c6-46a3-b3f2-a36bcc8b1df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:03.919964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6191d-e365-430b-803b-bb9ee6cdca79 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:03.921703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:03.936965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-66e1279a-71c6-46a3-b3f2-a36bcc8b1df4 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:03.938885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-66e1279a-71c6-46a3-b3f2-a36bcc8b1df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:03.960010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965b934-25d7-4e06-8554-8ff4bb789bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:03.960693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965b934-25d7-4e06-8554-8ff4bb789bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:03.960966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965b934-25d7-4e06-8554-8ff4bb789bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:03.961233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965b934-25d7-4e06-8554-8ff4bb789bd6 None admin] PATH_INFO: `/v3/users/7a57e5ee78334c3d8abcf656f9c79512` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:03.962445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965b934-25d7-4e06-8554-8ff4bb789bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=7a57e5ee78334c3d8abcf656f9c79512)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:03.963918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965b934-25d7-4e06-8554-8ff4bb789bd6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:03.965608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 21/40] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:03 2022] GET /identity/v3/users/7a57e5ee78334c3d8abcf656f9c79512 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:03.965608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965b934-25d7-4e06-8554-8ff4bb789bd6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:04.012098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 20/41] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:04.012926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1279a-71c6-46a3-b3f2-a36bcc8b1df4 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:04.070781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965b934-25d7-4e06-8554-8ff4bb789bd6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:04.106835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8c247-c362-41a0-8698-80795fd85528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:04.107589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8c247-c362-41a0-8698-80795fd85528 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:04.107871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8c247-c362-41a0-8698-80795fd85528 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:04.108143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8c247-c362-41a0-8698-80795fd85528 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:04.109507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8c247-c362-41a0-8698-80795fd85528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:04.110952 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8c247-c362-41a0-8698-80795fd85528 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:04.112992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 22/42] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:04.118023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1279a-71c6-46a3-b3f2-a36bcc8b1df4 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:04.118230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8c247-c362-41a0-8698-80795fd85528 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:04.120460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:04.153738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5391f-7303-4985-bf57-a07d5424773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:04.154386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5391f-7303-4985-bf57-a07d5424773e None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:04.154705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5391f-7303-4985-bf57-a07d5424773e None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:04.154980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5391f-7303-4985-bf57-a07d5424773e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:04.156097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5391f-7303-4985-bf57-a07d5424773e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:04.157593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5391f-7303-4985-bf57-a07d5424773e None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:04.159175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:04.165227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5391f-7303-4985-bf57-a07d5424773e None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:04.272920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:04.282987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5391f-7303-4985-bf57-a07d5424773e None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:04.318543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a319d6f-8e0a-4afc-97ef-54df36e09bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:04.319153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a319d6f-8e0a-4afc-97ef-54df36e09bab None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:04.319437 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a319d6f-8e0a-4afc-97ef-54df36e09bab None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:04.319710 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a319d6f-8e0a-4afc-97ef-54df36e09bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:04.320470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a319d6f-8e0a-4afc-97ef-54df36e09bab None admin] RBAC: Adding query filter params (role.id=67447f88528849c59df641acc7768c92, scope.domain.id=default, user.id=7a57e5ee78334c3d8abcf656f9c79512) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:04.320783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a319d6f-8e0a-4afc-97ef-54df36e09bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:04.322235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a319d6f-8e0a-4afc-97ef-54df36e09bab None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:04.343078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 22/44] 10.222.0.15 () {56 vars in 1322 bytes} [Mon Oct 24 12:59:04 2022] GET /identity/v3/role_assignments?user.id=7a57e5ee78334c3d8abcf656f9c79512&scope.domain.id=default&role.id=67447f88528849c59df641acc7768c92 => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:04.343078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a319d6f-8e0a-4afc-97ef-54df36e09bab None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:04.347175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8c247-c362-41a0-8698-80795fd85528 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:04.373560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:04.386032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea767ed9-93a7-44ed-9b88-3c7fadd8cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:04.386791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea767ed9-93a7-44ed-9b88-3c7fadd8cabe None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:04.387081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea767ed9-93a7-44ed-9b88-3c7fadd8cabe None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:04.387367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea767ed9-93a7-44ed-9b88-3c7fadd8cabe None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:04.388073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea767ed9-93a7-44ed-9b88-3c7fadd8cabe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:04.389640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea767ed9-93a7-44ed-9b88-3c7fadd8cabe None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:04.423748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 23/45] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 12:59:04 2022] POST /identity/v3/projects => generated 312 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 12:59:04.448936 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a319d6f-8e0a-4afc-97ef-54df36e09bab None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:04.490446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47802f72-7729-47ad-affa-5ad586348723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:04.491076 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47802f72-7729-47ad-affa-5ad586348723 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:04.491374 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47802f72-7729-47ad-affa-5ad586348723 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:04.491770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47802f72-7729-47ad-affa-5ad586348723 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:04.492482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47802f72-7729-47ad-affa-5ad586348723 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:04.493932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47802f72-7729-47ad-affa-5ad586348723 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:04.512241 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Oct 24 12:59:04 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:06.552699 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c296697-643b-40be-a4f4-9e027ff14adf None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:06.553588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c296697-643b-40be-a4f4-9e027ff14adf None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:06.553588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c296697-643b-40be-a4f4-9e027ff14adf None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:06.555799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 24/47] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:06.564926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2946be2-66aa-4568-a9ea-c46cc77e6b7b None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:06.565329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2946be2-66aa-4568-a9ea-c46cc77e6b7b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:06.565534 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2946be2-66aa-4568-a9ea-c46cc77e6b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:06.592007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-f2946be2-66aa-4568-a9ea-c46cc77e6b7b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:06.593274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f2946be2-66aa-4568-a9ea-c46cc77e6b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:06.668844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:06.934512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c296697-643b-40be-a4f4-9e027ff14adf None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:07.042685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:07.059715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c296697-643b-40be-a4f4-9e027ff14adf None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:07.098959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108c5c0-ae49-48ff-ac08-b8c5b407790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:07.099528 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108c5c0-ae49-48ff-ac08-b8c5b407790e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:07.099821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108c5c0-ae49-48ff-ac08-b8c5b407790e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:07.100093 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108c5c0-ae49-48ff-ac08-b8c5b407790e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:07.101401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108c5c0-ae49-48ff-ac08-b8c5b407790e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:07.102864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108c5c0-ae49-48ff-ac08-b8c5b407790e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:07.104509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 25/49] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:07.111359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2946be2-66aa-4568-a9ea-c46cc77e6b7b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:07.151552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:07.237359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2946be2-66aa-4568-a9ea-c46cc77e6b7b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:07.272415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d45c8-a182-4083-a2a6-38b5962f4067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:07.273021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d45c8-a182-4083-a2a6-38b5962f4067 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:07.273306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d45c8-a182-4083-a2a6-38b5962f4067 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:07.273576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d45c8-a182-4083-a2a6-38b5962f4067 None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:07.274236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d45c8-a182-4083-a2a6-38b5962f4067 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:07.275697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d45c8-a182-4083-a2a6-38b5962f4067 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:07.304657 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 25/50] 10.222.0.15 () {60 vars in 1140 bytes} [Mon Oct 24 12:59:07 2022] POST /identity/v3/projects => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:09.432600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7370930-465b-4675-8257-ad4790e18be6 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:09.433417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7370930-465b-4675-8257-ad4790e18be6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:09.433417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7370930-465b-4675-8257-ad4790e18be6 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:09.435643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 26/51] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:09.443778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e04fd-e1ac-4364-b2d6-f924ae7d691d None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:09.444161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e04fd-e1ac-4364-b2d6-f924ae7d691d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:09.444357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e04fd-e1ac-4364-b2d6-f924ae7d691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:09.462837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-642e04fd-e1ac-4364-b2d6-f924ae7d691d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:09.464035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-642e04fd-e1ac-4364-b2d6-f924ae7d691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:09.533565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 26/52] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:09.797631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7370930-465b-4675-8257-ad4790e18be6 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:09.910291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7370930-465b-4675-8257-ad4790e18be6 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:09.945964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e09bc-1a49-46ae-9366-b9e68907de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:09.946587 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e09bc-1a49-46ae-9366-b9e68907de1a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:09.946866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e09bc-1a49-46ae-9366-b9e68907de1a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:09.947138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e09bc-1a49-46ae-9366-b9e68907de1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:09.948282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e09bc-1a49-46ae-9366-b9e68907de1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:09.949750 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e09bc-1a49-46ae-9366-b9e68907de1a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:09.951340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 27/53] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:09.957702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e04fd-e1ac-4364-b2d6-f924ae7d691d None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:09.973367 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:10.065919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e04fd-e1ac-4364-b2d6-f924ae7d691d None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:10.099960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b98b83-788a-47de-8563-1b15535eea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:10.100593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98b83-788a-47de-8563-1b15535eea14 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:10.100875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98b83-788a-47de-8563-1b15535eea14 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:10.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98b83-788a-47de-8563-1b15535eea14 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:10.101798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b98b83-788a-47de-8563-1b15535eea14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:10.103250 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b98b83-788a-47de-8563-1b15535eea14 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:10.133750 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 27/54] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:09 2022] POST /identity/v3/users => generated 275 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:13.336675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6d422-4780-4a42-a5e7-f40cdcebc05e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:13.337729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6d422-4780-4a42-a5e7-f40cdcebc05e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:13.338214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6d422-4780-4a42-a5e7-f40cdcebc05e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:13.339848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 28/55] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:13.345424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1526ec0-10d3-4a73-9bbd-39240eea0831 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:13.346240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1526ec0-10d3-4a73-9bbd-39240eea0831 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:13.346725 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1526ec0-10d3-4a73-9bbd-39240eea0831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:13.489231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c1526ec0-10d3-4a73-9bbd-39240eea0831 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:13.490944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c1526ec0-10d3-4a73-9bbd-39240eea0831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:13.547576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e857-3ff5-4844-b918-bac5267f6b97 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:13.548198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e857-3ff5-4844-b918-bac5267f6b97 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:13.548716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e857-3ff5-4844-b918-bac5267f6b97 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:13.550276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 29/56] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:13.556147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:13.557824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe406d-f584-4642-8f1e-b356f0c44a20 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:13.558120 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe406d-f584-4642-8f1e-b356f0c44a20 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:13.558400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe406d-f584-4642-8f1e-b356f0c44a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:13.579489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 28/57] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:13.583847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-88fe406d-f584-4642-8f1e-b356f0c44a20 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:13.585111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-88fe406d-f584-4642-8f1e-b356f0c44a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:13.605511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307607-456c-4fe9-9729-a98e6bb6fbe6 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:13.605786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307607-456c-4fe9-9729-a98e6bb6fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:13.606000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307607-456c-4fe9-9729-a98e6bb6fbe6 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:13.607382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 29/58] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:13.613412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc0ac-ad09-4f06-a958-0443eca25e80 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:13.613699 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc0ac-ad09-4f06-a958-0443eca25e80 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:13.613977 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc0ac-ad09-4f06-a958-0443eca25e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:13.638036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-e36fc0ac-ad09-4f06-a958-0443eca25e80 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:13.639245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e36fc0ac-ad09-4f06-a958-0443eca25e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:13.640574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:13.720108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:13.760948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 30/60] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:13.847406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3371-b7b2-4c50-8bf1-ed9b8cb80b04 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:13.847697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3371-b7b2-4c50-8bf1-ed9b8cb80b04 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:13.847986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3371-b7b2-4c50-8bf1-ed9b8cb80b04 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:13.849667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 31/61] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:13.870121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498300e-2d9b-43a3-a04e-20a512ffabf7 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:13.870376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498300e-2d9b-43a3-a04e-20a512ffabf7 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:13.870616 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498300e-2d9b-43a3-a04e-20a512ffabf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:13.892112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-7498300e-2d9b-43a3-a04e-20a512ffabf7 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:13.893337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7498300e-2d9b-43a3-a04e-20a512ffabf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:13.919051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc3371-b7b2-4c50-8bf1-ed9b8cb80b04 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.013689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 31/62] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:14.065006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc3371-b7b2-4c50-8bf1-ed9b8cb80b04 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.068267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498300e-2d9b-43a3-a04e-20a512ffabf7 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.100278 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2c707-e932-49b0-8b99-e040d24dbfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.100990 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2c707-e932-49b0-8b99-e040d24dbfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.101267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2c707-e932-49b0-8b99-e040d24dbfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.101537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2c707-e932-49b0-8b99-e040d24dbfa1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.112508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2c707-e932-49b0-8b99-e040d24dbfa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-81c2c707-e932-49b0-8b99-e040d24dbfa1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:14.117849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:14.118708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 32/63] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:14.124781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2c707-e932-49b0-8b99-e040d24dbfa1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.144561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:14.149939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:14.203016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498300e-2d9b-43a3-a04e-20a512ffabf7 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.246835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95e9df-0bdd-4826-b067-873ff3ad33b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.248211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95e9df-0bdd-4826-b067-873ff3ad33b9 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.248654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95e9df-0bdd-4826-b067-873ff3ad33b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.249068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95e9df-0bdd-4826-b067-873ff3ad33b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.256846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2c707-e932-49b0-8b99-e040d24dbfa1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.261697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95e9df-0bdd-4826-b067-873ff3ad33b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-ff95e9df-0bdd-4826-b067-873ff3ad33b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:14.266570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:14.267383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:14.268133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 32/64] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 12:59:14.269513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95e9df-0bdd-4826-b067-873ff3ad33b9 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.292846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5509f-b1cb-443f-8347-54959f3177e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.293500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5509f-b1cb-443f-8347-54959f3177e9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.293781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5509f-b1cb-443f-8347-54959f3177e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.294055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5509f-b1cb-443f-8347-54959f3177e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.304226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5509f-b1cb-443f-8347-54959f3177e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-4ae5509f-b1cb-443f-8347-54959f3177e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:14.309117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:14.309983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:14.310781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 33/65] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:14.311435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08b387-7007-44b9-bcf0-09fb833dd18d None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.311883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08b387-7007-44b9-bcf0-09fb833dd18d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.312556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08b387-7007-44b9-bcf0-09fb833dd18d None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.313605 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 34/66] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:14.315229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08b387-7007-44b9-bcf0-09fb833dd18d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.372096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95e9df-0bdd-4826-b067-873ff3ad33b9 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.385994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:14.390001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:14.407609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7039d0-d882-4744-ba10-b1d6209c359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.408217 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7039d0-d882-4744-ba10-b1d6209c359b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.408529 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7039d0-d882-4744-ba10-b1d6209c359b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.408800 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7039d0-d882-4744-ba10-b1d6209c359b None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.409466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7039d0-d882-4744-ba10-b1d6209c359b None admin] RBAC: Adding query filter params (name=member) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:14.409768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7039d0-d882-4744-ba10-b1d6209c359b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:14.411203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7039d0-d882-4744-ba10-b1d6209c359b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:14.413337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08b387-7007-44b9-bcf0-09fb833dd18d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.419161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 33/67] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:14.423348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7039d0-d882-4744-ba10-b1d6209c359b None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.448475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b052-f475-42bc-8d71-e55b4cd3f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.449097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b052-f475-42bc-8d71-e55b4cd3f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.449378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b052-f475-42bc-8d71-e55b4cd3f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.449657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b052-f475-42bc-8d71-e55b4cd3f6d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.450331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6b052-f475-42bc-8d71-e55b4cd3f6d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:14.450640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6b052-f475-42bc-8d71-e55b4cd3f6d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:14.452045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6b052-f475-42bc-8d71-e55b4cd3f6d7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:14.460193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 35/68] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:14.463819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b052-f475-42bc-8d71-e55b4cd3f6d7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.522730 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7039d0-d882-4744-ba10-b1d6209c359b None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.555600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c272b-89ca-4deb-b1a8-53affb767b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.556247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c272b-89ca-4deb-b1a8-53affb767b83 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.556567 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c272b-89ca-4deb-b1a8-53affb767b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.556864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c272b-89ca-4deb-b1a8-53affb767b83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.562114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b052-f475-42bc-8d71-e55b4cd3f6d7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.566825 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c272b-89ca-4deb-b1a8-53affb767b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-962c272b-89ca-4deb-b1a8-53affb767b83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:14.572176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:14.573161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:14.573922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:14.574722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8662-bc9e-4bcf-a52f-5a50c998069c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.574853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8662-bc9e-4bcf-a52f-5a50c998069c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.575133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8662-bc9e-4bcf-a52f-5a50c998069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.592904 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-e5dd8662-bc9e-4bcf-a52f-5a50c998069c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:14.594108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e5dd8662-bc9e-4bcf-a52f-5a50c998069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:14.599595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f195c-452c-4d00-a36d-f18c29fa9084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.600203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f195c-452c-4d00-a36d-f18c29fa9084 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.600543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f195c-452c-4d00-a36d-f18c29fa9084 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.600793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f195c-452c-4d00-a36d-f18c29fa9084 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.601458 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f195c-452c-4d00-a36d-f18c29fa9084 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:14.601761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f195c-452c-4d00-a36d-f18c29fa9084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:14.603128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f195c-452c-4d00-a36d-f18c29fa9084 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:14.608548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:14.612673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 36/70] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:14.613462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f195c-452c-4d00-a36d-f18c29fa9084 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.626530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:14.663754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 35/71] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:14.668101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd8662-bc9e-4bcf-a52f-5a50c998069c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.713222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f195c-452c-4d00-a36d-f18c29fa9084 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.751536 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552e5e1-a2f9-43a5-a6e4-b20f301df5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.752198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552e5e1-a2f9-43a5-a6e4-b20f301df5da None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.752499 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552e5e1-a2f9-43a5-a6e4-b20f301df5da None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.752808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552e5e1-a2f9-43a5-a6e4-b20f301df5da None admin] PATH_INFO: `/v3/users/333639fe14644e7fb57fd1eb110c2ea3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.765581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd8662-bc9e-4bcf-a52f-5a50c998069c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.767129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552e5e1-a2f9-43a5-a6e4-b20f301df5da None admin] RBAC: Authorizing `identity:get_user(user_id=333639fe14644e7fb57fd1eb110c2ea3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:14.768751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552e5e1-a2f9-43a5-a6e4-b20f301df5da None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:14.770610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 37/72] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/users/333639fe14644e7fb57fd1eb110c2ea3 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:14.771176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552e5e1-a2f9-43a5-a6e4-b20f301df5da None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.806240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa7b07-04af-4a4d-a453-5fa9748f2144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.806896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa7b07-04af-4a4d-a453-5fa9748f2144 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.807179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa7b07-04af-4a4d-a453-5fa9748f2144 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.807455 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa7b07-04af-4a4d-a453-5fa9748f2144 None admin] PATH_INFO: `/v3/users/7a57e5ee78334c3d8abcf656f9c79512` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.808878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa7b07-04af-4a4d-a453-5fa9748f2144 None admin] RBAC: Authorizing `identity:get_user(user_id=7a57e5ee78334c3d8abcf656f9c79512)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:14.810349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa7b07-04af-4a4d-a453-5fa9748f2144 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:14.811964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/users/7a57e5ee78334c3d8abcf656f9c79512 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:14.812834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa7b07-04af-4a4d-a453-5fa9748f2144 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.834327 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:14.850601 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:14.884437 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552e5e1-a2f9-43a5-a6e4-b20f301df5da None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.919534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3653a-1dd7-45dc-8526-8dad226971ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.920106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3653a-1dd7-45dc-8526-8dad226971ce None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.920416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3653a-1dd7-45dc-8526-8dad226971ce None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.920692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3653a-1dd7-45dc-8526-8dad226971ce None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.921360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3653a-1dd7-45dc-8526-8dad226971ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:14.921664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3653a-1dd7-45dc-8526-8dad226971ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:14.923052 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3653a-1dd7-45dc-8526-8dad226971ce None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:14.925428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa7b07-04af-4a4d-a453-5fa9748f2144 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:14.931722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 38/74] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:14.932549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3653a-1dd7-45dc-8526-8dad226971ce None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:14.959901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f47250-82c1-45a1-b657-e7ff28d15803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:14.960598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f47250-82c1-45a1-b657-e7ff28d15803 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:14.960877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f47250-82c1-45a1-b657-e7ff28d15803 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:14.961152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f47250-82c1-45a1-b657-e7ff28d15803 None admin] PATH_INFO: `/v3/users/333639fe14644e7fb57fd1eb110c2ea3` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:14.962290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f47250-82c1-45a1-b657-e7ff28d15803 None admin] RBAC: Authorizing `identity:get_user(user_id=333639fe14644e7fb57fd1eb110c2ea3)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:14.963764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f47250-82c1-45a1-b657-e7ff28d15803 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:14.965393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/users/333639fe14644e7fb57fd1eb110c2ea3 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:14.966141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f47250-82c1-45a1-b657-e7ff28d15803 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:15.032484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3653a-1dd7-45dc-8526-8dad226971ce None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.052755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:15.065531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f47250-82c1-45a1-b657-e7ff28d15803 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.067132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:15.067508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c7397-33bc-452c-b898-f3b12b9266ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.068168 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7397-33bc-452c-b898-f3b12b9266ba None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.068518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7397-33bc-452c-b898-f3b12b9266ba None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.068797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7397-33bc-452c-b898-f3b12b9266ba None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.070203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c7397-33bc-452c-b898-f3b12b9266ba None admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.071654 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c7397-33bc-452c-b898-f3b12b9266ba None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:15.073338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 39/76] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:15.074097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c7397-33bc-452c-b898-f3b12b9266ba None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:15.103017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a91252-0229-4c23-9ad8-a590d3764ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.103660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91252-0229-4c23-9ad8-a590d3764ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.103963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91252-0229-4c23-9ad8-a590d3764ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.104229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91252-0229-4c23-9ad8-a590d3764ac0 None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.105444 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a91252-0229-4c23-9ad8-a590d3764ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.106887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a91252-0229-4c23-9ad8-a590d3764ac0 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:15.108628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 38/77] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:14 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:15.109452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a91252-0229-4c23-9ad8-a590d3764ac0 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:15.184193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c7397-33bc-452c-b898-f3b12b9266ba None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.208274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a91252-0229-4c23-9ad8-a590d3764ac0 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.218540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13426b-8c96-44aa-8048-51b9bdbf2b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.219173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13426b-8c96-44aa-8048-51b9bdbf2b2a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.219462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13426b-8c96-44aa-8048-51b9bdbf2b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.219751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13426b-8c96-44aa-8048-51b9bdbf2b2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.220887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13426b-8c96-44aa-8048-51b9bdbf2b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.222346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13426b-8c96-44aa-8048-51b9bdbf2b2a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:15.223986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 40/78] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:15.224783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13426b-8c96-44aa-8048-51b9bdbf2b2a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:15.242603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8008682-4807-41bc-be3d-48d1fc242d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.243247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008682-4807-41bc-be3d-48d1fc242d28 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.243528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008682-4807-41bc-be3d-48d1fc242d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.243834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008682-4807-41bc-be3d-48d1fc242d28 None admin] PATH_INFO: `/v3/users/333639fe14644e7fb57fd1eb110c2ea3` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.244972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8008682-4807-41bc-be3d-48d1fc242d28 None admin] RBAC: Authorizing `identity:get_user(user_id=333639fe14644e7fb57fd1eb110c2ea3)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.246425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8008682-4807-41bc-be3d-48d1fc242d28 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:15.248405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 39/79] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:15 2022] GET /identity/v3/users/333639fe14644e7fb57fd1eb110c2ea3 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:15.249141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8008682-4807-41bc-be3d-48d1fc242d28 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:15.282582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:15.288864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:15.326656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13426b-8c96-44aa-8048-51b9bdbf2b2a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.347696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8008682-4807-41bc-be3d-48d1fc242d28 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.359653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd252c2f-f6f0-4a1d-8619-1abc5dcf179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.360312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd252c2f-f6f0-4a1d-8619-1abc5dcf179c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.360599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd252c2f-f6f0-4a1d-8619-1abc5dcf179c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.360877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd252c2f-f6f0-4a1d-8619-1abc5dcf179c None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.361995 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd252c2f-f6f0-4a1d-8619-1abc5dcf179c None admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.363440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd252c2f-f6f0-4a1d-8619-1abc5dcf179c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:15.365157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 41/80] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:15 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:15.365892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd252c2f-f6f0-4a1d-8619-1abc5dcf179c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:15.385150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43fe5-00fd-4cfa-afd5-884c0334e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.385825 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43fe5-00fd-4cfa-afd5-884c0334e70f None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.386105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43fe5-00fd-4cfa-afd5-884c0334e70f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.386381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43fe5-00fd-4cfa-afd5-884c0334e70f None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633/users/333639fe14644e7fb57fd1eb110c2ea3/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.388385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c43fe5-00fd-4cfa-afd5-884c0334e70f None admin] RBAC: Authorizing `identity:create_grant(project_id=207f6da9736a443da019e48a2b2d7633, user_id=333639fe14644e7fb57fd1eb110c2ea3, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.389849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c43fe5-00fd-4cfa-afd5-884c0334e70f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:15.405741 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 40/81] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:15 2022] PUT /identity/v3/projects/207f6da9736a443da019e48a2b2d7633/users/333639fe14644e7fb57fd1eb110c2ea3/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:15.416561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43fe5-00fd-4cfa-afd5-884c0334e70f None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:15.480514 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd252c2f-f6f0-4a1d-8619-1abc5dcf179c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.506348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:15.517951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc9011-8af6-4246-8927-2237228ec9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.518643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc9011-8af6-4246-8927-2237228ec9bf None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.518928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc9011-8af6-4246-8927-2237228ec9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.519207 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc9011-8af6-4246-8927-2237228ec9bf None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633/users/7a57e5ee78334c3d8abcf656f9c79512/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.521295 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc9011-8af6-4246-8927-2237228ec9bf None admin] RBAC: Authorizing `identity:create_grant(project_id=207f6da9736a443da019e48a2b2d7633, user_id=7a57e5ee78334c3d8abcf656f9c79512, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.521685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:15.524617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc9011-8af6-4246-8927-2237228ec9bf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:15.525903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43fe5-00fd-4cfa-afd5-884c0334e70f None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.542294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 42/82] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:15 2022] PUT /identity/v3/projects/207f6da9736a443da019e48a2b2d7633/users/7a57e5ee78334c3d8abcf656f9c79512/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:15.543309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc9011-8af6-4246-8927-2237228ec9bf None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:15.578194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cc49c-cda6-4121-bbac-9263b019a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.579134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cc49c-cda6-4121-bbac-9263b019a51b None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.579569 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cc49c-cda6-4121-bbac-9263b019a51b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.579986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cc49c-cda6-4121-bbac-9263b019a51b None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.580896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cc49c-cda6-4121-bbac-9263b019a51b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.584146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cc49c-cda6-4121-bbac-9263b019a51b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:15.616835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 41/83] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:15 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:15.618054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cc49c-cda6-4121-bbac-9263b019a51b None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:15.748378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc9011-8af6-4246-8927-2237228ec9bf None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.795321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa527-aa36-4532-89c9-4638fd6e62d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.796556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa527-aa36-4532-89c9-4638fd6e62d7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.796932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa527-aa36-4532-89c9-4638fd6e62d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.797302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa527-aa36-4532-89c9-4638fd6e62d7 None admin] PATH_INFO: `/v3/projects/b7effc8bb5774e4cb63eb4e8712cfbed` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.798945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfa527-aa36-4532-89c9-4638fd6e62d7 None admin] RBAC: Authorizing `identity:get_project(project_id=b7effc8bb5774e4cb63eb4e8712cfbed)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.799660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cc49c-cda6-4121-bbac-9263b019a51b None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.800711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfa527-aa36-4532-89c9-4638fd6e62d7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:15.803863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 43/84] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:15 2022] GET /identity/v3/projects/b7effc8bb5774e4cb63eb4e8712cfbed => generated 312 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:15.810688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa527-aa36-4532-89c9-4638fd6e62d7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:15.845359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a078-835a-4931-8a7a-79592285505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.846058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a078-835a-4931-8a7a-79592285505b None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.846344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a078-835a-4931-8a7a-79592285505b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.846627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a078-835a-4931-8a7a-79592285505b None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633/users/333639fe14644e7fb57fd1eb110c2ea3/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.853975 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a078-835a-4931-8a7a-79592285505b None admin] RBAC: Authorizing `identity:create_grant(project_id=207f6da9736a443da019e48a2b2d7633, user_id=333639fe14644e7fb57fd1eb110c2ea3, role_id=e1bfcdd2169d4f49bb8a72e8dd7c33cf)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.855469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a078-835a-4931-8a7a-79592285505b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:15.876030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 42/85] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:15 2022] PUT /identity/v3/projects/207f6da9736a443da019e48a2b2d7633/users/333639fe14644e7fb57fd1eb110c2ea3/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:15.888412 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:15.946430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa527-aa36-4532-89c9-4638fd6e62d7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:15.984907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11185d1-aab3-4e57-b879-46de8be37813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:15.985631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11185d1-aab3-4e57-b879-46de8be37813 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:15.985919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11185d1-aab3-4e57-b879-46de8be37813 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:15.986262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11185d1-aab3-4e57-b879-46de8be37813 None admin] PATH_INFO: `/v3/projects/b7effc8bb5774e4cb63eb4e8712cfbed/users/333639fe14644e7fb57fd1eb110c2ea3/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:15.989293 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11185d1-aab3-4e57-b879-46de8be37813 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7effc8bb5774e4cb63eb4e8712cfbed, user_id=333639fe14644e7fb57fd1eb110c2ea3, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:15.990825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11185d1-aab3-4e57-b879-46de8be37813 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:16.008970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 44/86] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:15 2022] PUT /identity/v3/projects/b7effc8bb5774e4cb63eb4e8712cfbed/users/333639fe14644e7fb57fd1eb110c2ea3/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 12:59:18.220061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106abe-67b8-4315-8dbe-05254a6c99ca None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:18.220666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106abe-67b8-4315-8dbe-05254a6c99ca None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:18.220666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106abe-67b8-4315-8dbe-05254a6c99ca None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:18.222032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 43/87] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:18.227728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdaf45-8547-4039-95d1-d039812d4b30 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:18.228155 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdaf45-8547-4039-95d1-d039812d4b30 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:18.228370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdaf45-8547-4039-95d1-d039812d4b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:18.251094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e5bdaf45-8547-4039-95d1-d039812d4b30 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:18.252331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e5bdaf45-8547-4039-95d1-d039812d4b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:18.340462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 45/88] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:18.427144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6549049-820f-4975-a511-dd47e7798be8 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:18.427464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6549049-820f-4975-a511-dd47e7798be8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:18.427709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6549049-820f-4975-a511-dd47e7798be8 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:18.429134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 44/89] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:18.434378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23eca-c0e9-4588-82ec-2a5e2e9db165 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:18.434671 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23eca-c0e9-4588-82ec-2a5e2e9db165 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:18.434953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23eca-c0e9-4588-82ec-2a5e2e9db165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:18.461363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-dfa23eca-c0e9-4588-82ec-2a5e2e9db165 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:18.462576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-dfa23eca-c0e9-4588-82ec-2a5e2e9db165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:18.508216 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:18.545939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 46/90] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:18.824029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eacef2-a694-47cb-ad56-f3769ca247ab None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:18.824747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eacef2-a694-47cb-ad56-f3769ca247ab None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:18.825228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eacef2-a694-47cb-ad56-f3769ca247ab None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:18.826796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 45/91] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:18.832574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c72c6-fbcd-417c-be7a-17ca28fbf41f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:18.832936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c72c6-fbcd-417c-be7a-17ca28fbf41f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:18.833214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c72c6-fbcd-417c-be7a-17ca28fbf41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:18.848707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eacef2-a694-47cb-ad56-f3769ca247ab None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:18.864312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b37c72c6-fbcd-417c-be7a-17ca28fbf41f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:18.865520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b37c72c6-fbcd-417c-be7a-17ca28fbf41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:18.879644 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:18.987374 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 47/92] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:18.989614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c72c6-fbcd-417c-be7a-17ca28fbf41f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:19.027071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eacef2-a694-47cb-ad56-f3769ca247ab None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:19.100930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1648-f066-4a1e-a7a1-9b2dcbde17ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:19.101497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1648-f066-4a1e-a7a1-9b2dcbde17ab None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.101784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1648-f066-4a1e-a7a1-9b2dcbde17ab None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.102060 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1648-f066-4a1e-a7a1-9b2dcbde17ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.120598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b1648-f066-4a1e-a7a1-9b2dcbde17ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-788b1648-f066-4a1e-a7a1-9b2dcbde17ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:19.126465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:19.127366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:19.128134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:19.136855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 46/93] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 12:59:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 12:59:19.144581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1648-f066-4a1e-a7a1-9b2dcbde17ab None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:19.156048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c72c6-fbcd-417c-be7a-17ca28fbf41f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:19.167497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:19.229187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0732b2-fdf2-4c4c-887e-79f2b785686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:19.229962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0732b2-fdf2-4c4c-887e-79f2b785686f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.230157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0732b2-fdf2-4c4c-887e-79f2b785686f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.230430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0732b2-fdf2-4c4c-887e-79f2b785686f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.234653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:19.250452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0732b2-fdf2-4c4c-887e-79f2b785686f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:19.264389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1648-f066-4a1e-a7a1-9b2dcbde17ab None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2a0732b2-fdf2-4c4c-887e-79f2b785686f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:19.266681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:19.267537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:19.268722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 48/94] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:19.269392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae03529-fb81-457c-9b79-328cc0fbca83 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.269666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae03529-fb81-457c-9b79-328cc0fbca83 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.272060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae03529-fb81-457c-9b79-328cc0fbca83 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.279889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 49/95] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:19.280767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae03529-fb81-457c-9b79-328cc0fbca83 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:19.338106 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39316-2b46-43e7-bff7-99176b07842c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:19.338744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39316-2b46-43e7-bff7-99176b07842c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.339019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39316-2b46-43e7-bff7-99176b07842c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.339290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39316-2b46-43e7-bff7-99176b07842c None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.339966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab39316-2b46-43e7-bff7-99176b07842c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:19.340265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab39316-2b46-43e7-bff7-99176b07842c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:19.341679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab39316-2b46-43e7-bff7-99176b07842c None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:19.354806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 47/96] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 12:59:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:19.356030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486350e-d294-4fb7-86e4-f34f5ceaaab0 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.356345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486350e-d294-4fb7-86e4-f34f5ceaaab0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.356615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486350e-d294-4fb7-86e4-f34f5ceaaab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.376174 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-2486350e-d294-4fb7-86e4-f34f5ceaaab0 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:19.377867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2486350e-d294-4fb7-86e4-f34f5ceaaab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:19.420951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae03529-fb81-457c-9b79-328cc0fbca83 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:19.448209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 48/97] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:19.449716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38756ac-3668-4291-8831-c19e2f558081 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.450005 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38756ac-3668-4291-8831-c19e2f558081 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.450277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38756ac-3668-4291-8831-c19e2f558081 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.455831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 49/98] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:19.455831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38756ac-3668-4291-8831-c19e2f558081 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:19.468979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3784d07-f975-43a6-b803-46209c13de73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:19.469600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3784d07-f975-43a6-b803-46209c13de73 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.469884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3784d07-f975-43a6-b803-46209c13de73 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.470157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3784d07-f975-43a6-b803-46209c13de73 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.470866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3784d07-f975-43a6-b803-46209c13de73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:19.471142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3784d07-f975-43a6-b803-46209c13de73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:19.472580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3784d07-f975-43a6-b803-46209c13de73 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:19.484443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 50/99] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:19.484443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3784d07-f975-43a6-b803-46209c13de73 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:19.522153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:19.542246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:19.587643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38756ac-3668-4291-8831-c19e2f558081 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:19.605799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3784d07-f975-43a6-b803-46209c13de73 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:19.628879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e63602-001a-4493-91be-2223814f1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:19.629530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e63602-001a-4493-91be-2223814f1141 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.629834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e63602-001a-4493-91be-2223814f1141 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.630109 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e63602-001a-4493-91be-2223814f1141 None admin] PATH_INFO: `/v3/users/333639fe14644e7fb57fd1eb110c2ea3` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.631230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e63602-001a-4493-91be-2223814f1141 None admin] RBAC: Authorizing `identity:get_user(user_id=333639fe14644e7fb57fd1eb110c2ea3)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:19.632706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e63602-001a-4493-91be-2223814f1141 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:19.634333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 50/100] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:19 2022] GET /identity/v3/users/333639fe14644e7fb57fd1eb110c2ea3 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:19.635385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95667e81-ddeb-4e22-9601-2d7e249dce87 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.635664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95667e81-ddeb-4e22-9601-2d7e249dce87 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.635939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95667e81-ddeb-4e22-9601-2d7e249dce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.646096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a0c86-78fe-41ea-802f-346533c960e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:19.646762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0c86-78fe-41ea-802f-346533c960e5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.647043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0c86-78fe-41ea-802f-346533c960e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.647314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0c86-78fe-41ea-802f-346533c960e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.653759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-95667e81-ddeb-4e22-9601-2d7e249dce87 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:19.655155 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-95667e81-ddeb-4e22-9601-2d7e249dce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:19.657945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a0c86-78fe-41ea-802f-346533c960e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-233a0c86-78fe-41ea-802f-346533c960e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:19.663433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:19.664377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:19.665133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 51/101] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 12:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:19.665757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a0c86-78fe-41ea-802f-346533c960e5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:19.729517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 51/102] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:19.740345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5e85c-f210-4144-9d06-abc87186a7a4 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.740345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5e85c-f210-4144-9d06-abc87186a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.740345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5e85c-f210-4144-9d06-abc87186a7a4 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.740345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 52/103] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:19.740872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5e85c-f210-4144-9d06-abc87186a7a4 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:19.751992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:19.769886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a0c86-78fe-41ea-802f-346533c960e5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:19.805598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb2487-4420-486d-b6b6-27076b4fa5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:19.806235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2487-4420-486d-b6b6-27076b4fa5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.806514 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2487-4420-486d-b6b6-27076b4fa5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.806776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2487-4420-486d-b6b6-27076b4fa5c6 None admin] PATH_INFO: `/v3/users/333639fe14644e7fb57fd1eb110c2ea3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.807906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb2487-4420-486d-b6b6-27076b4fa5c6 None admin] RBAC: Authorizing `identity:get_user(user_id=333639fe14644e7fb57fd1eb110c2ea3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:19.809404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb2487-4420-486d-b6b6-27076b4fa5c6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:19.810485 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:19.811165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 52/104] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:19 2022] GET /identity/v3/users/333639fe14644e7fb57fd1eb110c2ea3 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:19.813183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb2487-4420-486d-b6b6-27076b4fa5c6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:19.858507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5e85c-f210-4144-9d06-abc87186a7a4 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:19.894068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbe7c8-c36d-40ca-aae1-00eb3c181a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:19.894687 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbe7c8-c36d-40ca-aae1-00eb3c181a81 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.894967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbe7c8-c36d-40ca-aae1-00eb3c181a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.895278 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbe7c8-c36d-40ca-aae1-00eb3c181a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.920151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb2487-4420-486d-b6b6-27076b4fa5c6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:19.951876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad894a0-bb1b-459b-afa9-f0fe22efb34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:19.952491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad894a0-bb1b-459b-afa9-f0fe22efb34d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.952800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad894a0-bb1b-459b-afa9-f0fe22efb34d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.953047 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad894a0-bb1b-459b-afa9-f0fe22efb34d None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.953710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad894a0-bb1b-459b-afa9-f0fe22efb34d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:19.954015 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad894a0-bb1b-459b-afa9-f0fe22efb34d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:19.955395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad894a0-bb1b-459b-afa9-f0fe22efb34d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:19.963413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 53/105] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:19.964593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b37f8-87dc-44b4-853a-08bc68d5461d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:19.964872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b37f8-87dc-44b4-853a-08bc68d5461d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:19.965147 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b37f8-87dc-44b4-853a-08bc68d5461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:19.970848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbe7c8-c36d-40ca-aae1-00eb3c181a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:19.972343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbe7c8-c36d-40ca-aae1-00eb3c181a81 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:19.984748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-054b37f8-87dc-44b4-853a-08bc68d5461d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:19.986239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-054b37f8-87dc-44b4-853a-08bc68d5461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:19.996182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:20.031641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:20.053041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 54/106] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:20.053877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b37f8-87dc-44b4-853a-08bc68d5461d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.069563 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 53/107] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 12:59:20.070327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbe7c8-c36d-40ca-aae1-00eb3c181a81 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.169305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b37f8-87dc-44b4-853a-08bc68d5461d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:20.178522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbe7c8-c36d-40ca-aae1-00eb3c181a81 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:20.205045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380229a8-bbf6-47a3-b31b-5afcfb3f65fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:20.205683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380229a8-bbf6-47a3-b31b-5afcfb3f65fd None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:20.206091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380229a8-bbf6-47a3-b31b-5afcfb3f65fd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:20.206351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380229a8-bbf6-47a3-b31b-5afcfb3f65fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:20.211196 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d4a83-0cb3-4956-9f94-4542562e87d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:20.211806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d4a83-0cb3-4956-9f94-4542562e87d4 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:20.212085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d4a83-0cb3-4956-9f94-4542562e87d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:20.212383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d4a83-0cb3-4956-9f94-4542562e87d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:20.217085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380229a8-bbf6-47a3-b31b-5afcfb3f65fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-380229a8-bbf6-47a3-b31b-5afcfb3f65fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:20.222204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:20.223230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:20.224050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 55/108] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:20.224717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380229a8-bbf6-47a3-b31b-5afcfb3f65fd None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.228504 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:20.248145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:20.285672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d4a83-0cb3-4956-9f94-4542562e87d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:20.287223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d4a83-0cb3-4956-9f94-4542562e87d4 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:20.330848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380229a8-bbf6-47a3-b31b-5afcfb3f65fd None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:20.363468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f2a88-61e5-44be-b6c2-4210c4281a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:20.364160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f2a88-61e5-44be-b6c2-4210c4281a6a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:20.364498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f2a88-61e5-44be-b6c2-4210c4281a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:20.364778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f2a88-61e5-44be-b6c2-4210c4281a6a None admin] PATH_INFO: `/v3/users/7a57e5ee78334c3d8abcf656f9c79512` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:20.365923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f2a88-61e5-44be-b6c2-4210c4281a6a None admin] RBAC: Authorizing `identity:get_user(user_id=7a57e5ee78334c3d8abcf656f9c79512)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:20.367389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f2a88-61e5-44be-b6c2-4210c4281a6a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:20.369039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 56/109] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/users/7a57e5ee78334c3d8abcf656f9c79512 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:20.369796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f2a88-61e5-44be-b6c2-4210c4281a6a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.383661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 54/110] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 12:59:20.384537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d4a83-0cb3-4956-9f94-4542562e87d4 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.437693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:20.444592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:20.467060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f2a88-61e5-44be-b6c2-4210c4281a6a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:20.481985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d4a83-0cb3-4956-9f94-4542562e87d4 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:20.502174 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db150f8-4630-4467-961a-b0d1472b516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:20.502792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db150f8-4630-4467-961a-b0d1472b516b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:20.503070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db150f8-4630-4467-961a-b0d1472b516b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:20.503342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db150f8-4630-4467-961a-b0d1472b516b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:20.504476 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db150f8-4630-4467-961a-b0d1472b516b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:20.505998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db150f8-4630-4467-961a-b0d1472b516b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:20.507584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 57/111] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:20.508380 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db150f8-4630-4467-961a-b0d1472b516b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.516620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c9573-714f-49dc-81da-7de0cc322464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:20.517257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c9573-714f-49dc-81da-7de0cc322464 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:20.517537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c9573-714f-49dc-81da-7de0cc322464 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:20.517811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c9573-714f-49dc-81da-7de0cc322464 None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:20.518983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c9573-714f-49dc-81da-7de0cc322464 None admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:20.520523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c9573-714f-49dc-81da-7de0cc322464 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:20.522150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 55/112] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:20.522987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c9573-714f-49dc-81da-7de0cc322464 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.606952 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db150f8-4630-4467-961a-b0d1472b516b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:20.619405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c9573-714f-49dc-81da-7de0cc322464 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:20.641942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386efd4-d1ec-4a1c-a2be-192217c43f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:20.642646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386efd4-d1ec-4a1c-a2be-192217c43f46 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:20.642986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386efd4-d1ec-4a1c-a2be-192217c43f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:20.643320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386efd4-d1ec-4a1c-a2be-192217c43f46 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:20.643983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386efd4-d1ec-4a1c-a2be-192217c43f46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:20.644317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386efd4-d1ec-4a1c-a2be-192217c43f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:20.645751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386efd4-d1ec-4a1c-a2be-192217c43f46 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:20.648550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:20.654248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 58/113] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:20.654368 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4cd1b-fd01-4a82-bdec-92039eb07637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:20.654874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4cd1b-fd01-4a82-bdec-92039eb07637 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:20.654992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386efd4-d1ec-4a1c-a2be-192217c43f46 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.655209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4cd1b-fd01-4a82-bdec-92039eb07637 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:20.655490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4cd1b-fd01-4a82-bdec-92039eb07637 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:20.657507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:20.667970 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4cd1b-fd01-4a82-bdec-92039eb07637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-57b4cd1b-fd01-4a82-bdec-92039eb07637 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:20.672866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:20.673795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 56/114] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:20.679497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4cd1b-fd01-4a82-bdec-92039eb07637 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.756036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386efd4-d1ec-4a1c-a2be-192217c43f46 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:20.772130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4cd1b-fd01-4a82-bdec-92039eb07637 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:20.789008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332d174-ed42-4db4-806e-d03c85652dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:20.789627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d174-ed42-4db4-806e-d03c85652dfe None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:20.789907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d174-ed42-4db4-806e-d03c85652dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:20.790181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332d174-ed42-4db4-806e-d03c85652dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:20.805522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc49c-00ba-4a3b-8c69-a202279df6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:20.806150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc49c-00ba-4a3b-8c69-a202279df6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:20.806428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc49c-00ba-4a3b-8c69-a202279df6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:20.806698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc49c-00ba-4a3b-8c69-a202279df6e1 None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:20.807809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edc49c-00ba-4a3b-8c69-a202279df6e1 None admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:20.809307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edc49c-00ba-4a3b-8c69-a202279df6e1 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:20.811121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 57/115] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:20.811695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc49c-00ba-4a3b-8c69-a202279df6e1 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.860923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332d174-ed42-4db4-806e-d03c85652dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:20.862413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332d174-ed42-4db4-806e-d03c85652dfe None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:20.864258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:20.873255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:20.914317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc49c-00ba-4a3b-8c69-a202279df6e1 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:20.947835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a83eb-bfe4-4d23-9f32-820a7dbdffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:20.948477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a83eb-bfe4-4d23-9f32-820a7dbdffad None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:20.948759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a83eb-bfe4-4d23-9f32-820a7dbdffad None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:20.949028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a83eb-bfe4-4d23-9f32-820a7dbdffad None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:20.949683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a83eb-bfe4-4d23-9f32-820a7dbdffad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:20.951145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a83eb-bfe4-4d23-9f32-820a7dbdffad None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:20.958767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 59/116] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 12:59:20.959607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332d174-ed42-4db4-806e-d03c85652dfe None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:20.980856 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 58/117] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 12:59:20 2022] POST /identity/v3/projects => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:20.981678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a83eb-bfe4-4d23-9f32-820a7dbdffad None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:21.071548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332d174-ed42-4db4-806e-d03c85652dfe None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:21.073150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:21.109737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a05227-2042-4fc6-bb7b-d7fd4183bcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:21.110442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a05227-2042-4fc6-bb7b-d7fd4183bcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:21.110724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a05227-2042-4fc6-bb7b-d7fd4183bcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:21.111052 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a05227-2042-4fc6-bb7b-d7fd4183bcc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:21.111818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a05227-2042-4fc6-bb7b-d7fd4183bcc3 None admin] RBAC: Adding query filter params (role.id=e1bfcdd2169d4f49bb8a72e8dd7c33cf, scope.project.id=207f6da9736a443da019e48a2b2d7633, user.id=333639fe14644e7fb57fd1eb110c2ea3) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:21.112126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a05227-2042-4fc6-bb7b-d7fd4183bcc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:21.113728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a05227-2042-4fc6-bb7b-d7fd4183bcc3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:21.115342 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a83eb-bfe4-4d23-9f32-820a7dbdffad None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:21.123405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 60/118] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/role_assignments?user.id=333639fe14644e7fb57fd1eb110c2ea3&scope.project.id=207f6da9736a443da019e48a2b2d7633&role.id=e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:21.123405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a05227-2042-4fc6-bb7b-d7fd4183bcc3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:21.134472 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:21.165853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb8ad-30cc-4889-be24-b850263fc81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:21.166524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb8ad-30cc-4889-be24-b850263fc81e None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:21.166805 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb8ad-30cc-4889-be24-b850263fc81e None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:21.167081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb8ad-30cc-4889-be24-b850263fc81e None admin] PATH_INFO: `/v3/users/333639fe14644e7fb57fd1eb110c2ea3` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:21.168322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fb8ad-30cc-4889-be24-b850263fc81e None admin] RBAC: Authorizing `identity:get_user(user_id=333639fe14644e7fb57fd1eb110c2ea3)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:21.169821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fb8ad-30cc-4889-be24-b850263fc81e None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:21.171643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 59/119] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:20 2022] GET /identity/v3/users/333639fe14644e7fb57fd1eb110c2ea3 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:21.172268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb8ad-30cc-4889-be24-b850263fc81e None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:21.257035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a05227-2042-4fc6-bb7b-d7fd4183bcc3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:21.293861 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6804f-1bc7-4580-bd20-cc8d0a188f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:21.294494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6804f-1bc7-4580-bd20-cc8d0a188f12 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:21.294772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6804f-1bc7-4580-bd20-cc8d0a188f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:21.295040 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6804f-1bc7-4580-bd20-cc8d0a188f12 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:21.295725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6804f-1bc7-4580-bd20-cc8d0a188f12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:21.296024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6804f-1bc7-4580-bd20-cc8d0a188f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:21.297635 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6804f-1bc7-4580-bd20-cc8d0a188f12 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:21.306464 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 61/120] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:21.307337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6804f-1bc7-4580-bd20-cc8d0a188f12 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:21.319912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb8ad-30cc-4889-be24-b850263fc81e None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:21.345621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:21.363596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5c7a-3fcd-4eb2-b388-d691e49a7db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:21.364641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5c7a-3fcd-4eb2-b388-d691e49a7db5 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:21.364984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5c7a-3fcd-4eb2-b388-d691e49a7db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:21.365342 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5c7a-3fcd-4eb2-b388-d691e49a7db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:21.366589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5c7a-3fcd-4eb2-b388-d691e49a7db5 None admin] RBAC: Adding query filter params (role.id=5a473059a779480ca6031449b18aeb52, scope.project.id=207f6da9736a443da019e48a2b2d7633, user.id=333639fe14644e7fb57fd1eb110c2ea3) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:21.366589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5c7a-3fcd-4eb2-b388-d691e49a7db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:21.368258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5c7a-3fcd-4eb2-b388-d691e49a7db5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:21.374889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 60/121] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 12:59:21 2022] GET /identity/v3/role_assignments?user.id=333639fe14644e7fb57fd1eb110c2ea3&scope.project.id=207f6da9736a443da019e48a2b2d7633&role.id=5a473059a779480ca6031449b18aeb52 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:21.375779 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5c7a-3fcd-4eb2-b388-d691e49a7db5 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:21.431743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:21.432660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6804f-1bc7-4580-bd20-cc8d0a188f12 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:21.488405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4cb4-0826-432e-ad9c-f677590b9df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:21.489245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4cb4-0826-432e-ad9c-f677590b9df5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:21.489594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4cb4-0826-432e-ad9c-f677590b9df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:21.489938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4cb4-0826-432e-ad9c-f677590b9df5 None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:21.492011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af4cb4-0826-432e-ad9c-f677590b9df5 None admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:21.493919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af4cb4-0826-432e-ad9c-f677590b9df5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:21.500324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 62/122] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:21 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:21.500324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4cb4-0826-432e-ad9c-f677590b9df5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:21.514532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5c7a-3fcd-4eb2-b388-d691e49a7db5 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:21.559782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b566c04-42bb-4ac4-bbc4-afdcad093f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:21.560861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b566c04-42bb-4ac4-bbc4-afdcad093f44 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:21.561381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b566c04-42bb-4ac4-bbc4-afdcad093f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:21.561872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b566c04-42bb-4ac4-bbc4-afdcad093f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:21.618961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:21.627683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4cb4-0826-432e-ad9c-f677590b9df5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:21.652342 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b566c04-42bb-4ac4-bbc4-afdcad093f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:21.653551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b566c04-42bb-4ac4-bbc4-afdcad093f44 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:21.678366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee446d-386f-46b8-a062-b6424dfaf6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:21.680165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee446d-386f-46b8-a062-b6424dfaf6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:21.685157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee446d-386f-46b8-a062-b6424dfaf6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:21.685267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee446d-386f-46b8-a062-b6424dfaf6f1 None admin] PATH_INFO: `/v3/users/0936817b5f4f41fa920f7c9eb466df2d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:21.701594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee446d-386f-46b8-a062-b6424dfaf6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=0936817b5f4f41fa920f7c9eb466df2d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:21.703062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee446d-386f-46b8-a062-b6424dfaf6f1 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:21.704775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 63/123] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:21 2022] GET /identity/v3/users/0936817b5f4f41fa920f7c9eb466df2d => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:21.705151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:21.710308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee446d-386f-46b8-a062-b6424dfaf6f1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:21.764886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 61/124] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 12:59:21.765933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b566c04-42bb-4ac4-bbc4-afdcad093f44 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:21.816025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee446d-386f-46b8-a062-b6424dfaf6f1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:21.853431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd74ddc-6996-44a1-a753-a7c24547ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:21.854366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd74ddc-6996-44a1-a753-a7c24547ff13 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:21.854649 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd74ddc-6996-44a1-a753-a7c24547ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:21.854923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd74ddc-6996-44a1-a753-a7c24547ff13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:21.856347 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd74ddc-6996-44a1-a753-a7c24547ff13 None admin] RBAC: Adding query filter params (role.id=67447f88528849c59df641acc7768c92, scope.project.id=207f6da9736a443da019e48a2b2d7633, user.id=7a57e5ee78334c3d8abcf656f9c79512) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:21.856678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd74ddc-6996-44a1-a753-a7c24547ff13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:21.858166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd74ddc-6996-44a1-a753-a7c24547ff13 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:21.864591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 64/125] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 12:59:21 2022] GET /identity/v3/role_assignments?user.id=7a57e5ee78334c3d8abcf656f9c79512&scope.project.id=207f6da9736a443da019e48a2b2d7633&role.id=67447f88528849c59df641acc7768c92 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:21.875332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b566c04-42bb-4ac4-bbc4-afdcad093f44 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:21.878787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd74ddc-6996-44a1-a753-a7c24547ff13 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:21.907231 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:21.915798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa81c8-46e1-4f7c-aac9-bd638656fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:21.916661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa81c8-46e1-4f7c-aac9-bd638656fa06 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:21.917069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa81c8-46e1-4f7c-aac9-bd638656fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:21.917420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa81c8-46e1-4f7c-aac9-bd638656fa06 None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:21.918743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa81c8-46e1-4f7c-aac9-bd638656fa06 None admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:21.920378 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa81c8-46e1-4f7c-aac9-bd638656fa06 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:21.922258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 62/126] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:21 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:21.928476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa81c8-46e1-4f7c-aac9-bd638656fa06 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:21.949071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:22.030114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd74ddc-6996-44a1-a753-a7c24547ff13 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:22.073423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa81c8-46e1-4f7c-aac9-bd638656fa06 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:22.075997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc256bf-368d-48b1-b83a-cbc82a982ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:22.077502 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc256bf-368d-48b1-b83a-cbc82a982ffb None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:22.077795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc256bf-368d-48b1-b83a-cbc82a982ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:22.078077 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc256bf-368d-48b1-b83a-cbc82a982ffb None admin] PATH_INFO: `/v3/projects/b7effc8bb5774e4cb63eb4e8712cfbed` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:22.079241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc256bf-368d-48b1-b83a-cbc82a982ffb None admin] RBAC: Authorizing `identity:get_project(project_id=b7effc8bb5774e4cb63eb4e8712cfbed)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:22.080763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc256bf-368d-48b1-b83a-cbc82a982ffb None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:22.083071 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 65/127] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:21 2022] GET /identity/v3/projects/b7effc8bb5774e4cb63eb4e8712cfbed => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:22.090041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc256bf-368d-48b1-b83a-cbc82a982ffb None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:22.119793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fd0d6-0201-4ce3-9d7c-115b09db1f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:22.119793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fd0d6-0201-4ce3-9d7c-115b09db1f6a None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:22.120119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fd0d6-0201-4ce3-9d7c-115b09db1f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:22.120190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fd0d6-0201-4ce3-9d7c-115b09db1f6a None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633/users/0936817b5f4f41fa920f7c9eb466df2d/roles/c1842e25399a42b980fe646bb06ac0d9` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:22.123545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fd0d6-0201-4ce3-9d7c-115b09db1f6a None admin] RBAC: Authorizing `identity:create_grant(project_id=207f6da9736a443da019e48a2b2d7633, user_id=0936817b5f4f41fa920f7c9eb466df2d, role_id=c1842e25399a42b980fe646bb06ac0d9)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:22.125449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fd0d6-0201-4ce3-9d7c-115b09db1f6a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:22.141728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 63/128] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:21 2022] PUT /identity/v3/projects/207f6da9736a443da019e48a2b2d7633/users/0936817b5f4f41fa920f7c9eb466df2d/roles/c1842e25399a42b980fe646bb06ac0d9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 12:59:22.189268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:22.207210 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc256bf-368d-48b1-b83a-cbc82a982ffb None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:22.245248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367458ae-86ef-4c93-9a93-f59a59f68a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:22.245881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367458ae-86ef-4c93-9a93-f59a59f68a8c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:22.246156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367458ae-86ef-4c93-9a93-f59a59f68a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:22.246432 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367458ae-86ef-4c93-9a93-f59a59f68a8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:22.247201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367458ae-86ef-4c93-9a93-f59a59f68a8c None admin] RBAC: Adding query filter params (role.id=5a473059a779480ca6031449b18aeb52, scope.project.id=b7effc8bb5774e4cb63eb4e8712cfbed, user.id=333639fe14644e7fb57fd1eb110c2ea3) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:22.247512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367458ae-86ef-4c93-9a93-f59a59f68a8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:22.249422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367458ae-86ef-4c93-9a93-f59a59f68a8c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:22.256609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 66/129] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 12:59:22 2022] GET /identity/v3/role_assignments?user.id=333639fe14644e7fb57fd1eb110c2ea3&scope.project.id=b7effc8bb5774e4cb63eb4e8712cfbed&role.id=5a473059a779480ca6031449b18aeb52 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:23.235132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a11aa-6a05-429c-8d1f-c0811e98fdc1 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:23.235681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a11aa-6a05-429c-8d1f-c0811e98fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:23.235681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a11aa-6a05-429c-8d1f-c0811e98fdc1 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:23.237111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 64/130] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:23.242571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953387e-e75f-4c64-bfe2-32b3b3641a9f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:23.243000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953387e-e75f-4c64-bfe2-32b3b3641a9f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:23.243081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953387e-e75f-4c64-bfe2-32b3b3641a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:23.262055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c953387e-e75f-4c64-bfe2-32b3b3641a9f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:23.263226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c953387e-e75f-4c64-bfe2-32b3b3641a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:23.329205 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 67/131] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:23.592188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a11aa-6a05-429c-8d1f-c0811e98fdc1 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:23.664516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:23.698398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a11aa-6a05-429c-8d1f-c0811e98fdc1 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:23.732947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc415-119f-4f01-baf8-cb05056cc3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:23.733577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc415-119f-4f01-baf8-cb05056cc3ff None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:23.733858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc415-119f-4f01-baf8-cb05056cc3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:23.734130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc415-119f-4f01-baf8-cb05056cc3ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:23.735245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc415-119f-4f01-baf8-cb05056cc3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:23.736750 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc415-119f-4f01-baf8-cb05056cc3ff None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:23.738327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 65/132] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:23.744054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953387e-e75f-4c64-bfe2-32b3b3641a9f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:23.825722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:23.846877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953387e-e75f-4c64-bfe2-32b3b3641a9f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:23.882442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e78bdb-c459-468f-8583-83b2d95b1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:23.883068 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78bdb-c459-468f-8583-83b2d95b1745 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:23.883347 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78bdb-c459-468f-8583-83b2d95b1745 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:23.883616 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78bdb-c459-468f-8583-83b2d95b1745 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:23.884282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78bdb-c459-468f-8583-83b2d95b1745 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:23.885775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78bdb-c459-468f-8583-83b2d95b1745 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:23.912274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 68/133] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:23 2022] POST /identity/v3/users => generated 283 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:24.276094 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf0f8-393c-4e53-a7fa-edee44b5fd61 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:24.276720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf0f8-393c-4e53-a7fa-edee44b5fd61 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:24.276720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf0f8-393c-4e53-a7fa-edee44b5fd61 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:24.278145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 66/134] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:24.283641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d5a1-562e-4915-b7fc-e6926c31fd5b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:24.284102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d5a1-562e-4915-b7fc-e6926c31fd5b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:24.284183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d5a1-562e-4915-b7fc-e6926c31fd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:24.304972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-fe31d5a1-562e-4915-b7fc-e6926c31fd5b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:24.306181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fe31d5a1-562e-4915-b7fc-e6926c31fd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:24.376938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 69/135] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:24.642759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdf0f8-393c-4e53-a7fa-edee44b5fd61 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:24.752317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdf0f8-393c-4e53-a7fa-edee44b5fd61 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:24.783061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d412-40c1-4a57-a21f-0781ccd7b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:24.783703 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d412-40c1-4a57-a21f-0781ccd7b0bd None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:24.783983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d412-40c1-4a57-a21f-0781ccd7b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:24.784256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d412-40c1-4a57-a21f-0781ccd7b0bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:24.792034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:24.795057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2d412-40c1-4a57-a21f-0781ccd7b0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-b8f2d412-40c1-4a57-a21f-0781ccd7b0bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:24.800074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:24.801135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:24.802046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 67/136] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:24.809028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d5a1-562e-4915-b7fc-e6926c31fd5b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:24.877624 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:24.920838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d5a1-562e-4915-b7fc-e6926c31fd5b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:24.956257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb37ec-1411-4423-90c6-01e9b89ad4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:24.956961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb37ec-1411-4423-90c6-01e9b89ad4ec None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:24.957250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb37ec-1411-4423-90c6-01e9b89ad4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:24.957528 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb37ec-1411-4423-90c6-01e9b89ad4ec None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:24.958242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb37ec-1411-4423-90c6-01e9b89ad4ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:24.958555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb37ec-1411-4423-90c6-01e9b89ad4ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:24.959989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb37ec-1411-4423-90c6-01e9b89ad4ec None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:24.969022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 70/137] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:24.975009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d412-40c1-4a57-a21f-0781ccd7b0bd None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:25.081410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d412-40c1-4a57-a21f-0781ccd7b0bd None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:25.115377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fbaf0-caad-446b-a97b-2de494f88b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:25.116020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fbaf0-caad-446b-a97b-2de494f88b4c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:25.116321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fbaf0-caad-446b-a97b-2de494f88b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:25.116687 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fbaf0-caad-446b-a97b-2de494f88b4c None admin] PATH_INFO: `/v3/users/0936817b5f4f41fa920f7c9eb466df2d` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:25.117812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fbaf0-caad-446b-a97b-2de494f88b4c None admin] RBAC: Authorizing `identity:get_user(user_id=0936817b5f4f41fa920f7c9eb466df2d)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:25.119265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fbaf0-caad-446b-a97b-2de494f88b4c None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:25.120895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 68/138] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:24 2022] GET /identity/v3/users/0936817b5f4f41fa920f7c9eb466df2d => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:25.127028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb37ec-1411-4423-90c6-01e9b89ad4ec None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:25.233520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb37ec-1411-4423-90c6-01e9b89ad4ec None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:25.268507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:25.276782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd105411-c113-473c-acd5-e57d67f86a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:25.277406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd105411-c113-473c-acd5-e57d67f86a7a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:25.277686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd105411-c113-473c-acd5-e57d67f86a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:25.277964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd105411-c113-473c-acd5-e57d67f86a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:25.347169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd105411-c113-473c-acd5-e57d67f86a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:25.348717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd105411-c113-473c-acd5-e57d67f86a7a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:25.450203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 71/139] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 12:59:25.456051 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fbaf0-caad-446b-a97b-2de494f88b4c None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:25.526870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:25.560527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fbaf0-caad-446b-a97b-2de494f88b4c None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:25.594491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf3240-a9e9-4561-a097-8374934c81d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:25.595142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf3240-a9e9-4561-a097-8374934c81d4 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:25.595464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf3240-a9e9-4561-a097-8374934c81d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:25.595748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf3240-a9e9-4561-a097-8374934c81d4 None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:25.596963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf3240-a9e9-4561-a097-8374934c81d4 None admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:25.598474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf3240-a9e9-4561-a097-8374934c81d4 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:25.600205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 69/140] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:25 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:25.606462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd105411-c113-473c-acd5-e57d67f86a7a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:25.635689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:25.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd105411-c113-473c-acd5-e57d67f86a7a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:25.746865 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbca3c4-a0dd-44b2-927c-f53772b96a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:25.748239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca3c4-a0dd-44b2-927c-f53772b96a63 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:25.748746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca3c4-a0dd-44b2-927c-f53772b96a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:25.749199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca3c4-a0dd-44b2-927c-f53772b96a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:25.750150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbca3c4-a0dd-44b2-927c-f53772b96a63 None admin] RBAC: Adding query filter params (role.id=c1842e25399a42b980fe646bb06ac0d9, scope.project.id=207f6da9736a443da019e48a2b2d7633, user.id=0936817b5f4f41fa920f7c9eb466df2d) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:25.750682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbca3c4-a0dd-44b2-927c-f53772b96a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:25.752489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbca3c4-a0dd-44b2-927c-f53772b96a63 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:25.759013 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 72/141] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 12:59:25 2022] GET /identity/v3/role_assignments?user.id=0936817b5f4f41fa920f7c9eb466df2d&scope.project.id=207f6da9736a443da019e48a2b2d7633&role.id=c1842e25399a42b980fe646bb06ac0d9 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:26.190158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd4e66-2dba-4922-bfdd-ebd69aa82db8 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:26.190591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd4e66-2dba-4922-bfdd-ebd69aa82db8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:26.190689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd4e66-2dba-4922-bfdd-ebd69aa82db8 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:26.192151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 70/142] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:26.197329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2e76-57d5-4007-a178-669656054050 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:26.197621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2e76-57d5-4007-a178-669656054050 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:26.197895 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2e76-57d5-4007-a178-669656054050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:26.216804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-826e2e76-57d5-4007-a178-669656054050 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:26.218002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-826e2e76-57d5-4007-a178-669656054050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:26.291058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 73/143] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:26.427895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef4e57-6529-4705-9912-a67a0d5f96d0 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:26.428149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef4e57-6529-4705-9912-a67a0d5f96d0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:26.428625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef4e57-6529-4705-9912-a67a0d5f96d0 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:26.430207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 71/144] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:26.435653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf054fb1-4195-4422-8c24-2672d15719b6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:26.436493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf054fb1-4195-4422-8c24-2672d15719b6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:26.436981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf054fb1-4195-4422-8c24-2672d15719b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:26.455006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24885-0863-4c03-bf5b-ac6dbd7eb39e None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:26.455186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24885-0863-4c03-bf5b-ac6dbd7eb39e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:26.455441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24885-0863-4c03-bf5b-ac6dbd7eb39e None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:26.456547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-bf054fb1-4195-4422-8c24-2672d15719b6 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:26.456825 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 72/145] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:26.458119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bf054fb1-4195-4422-8c24-2672d15719b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:26.461581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f04c9-a1be-4616-98e1-1cb5173ecd36 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:26.461864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f04c9-a1be-4616-98e1-1cb5173ecd36 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:26.462137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f04c9-a1be-4616-98e1-1cb5173ecd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:26.476407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:26.481648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-796f04c9-a1be-4616-98e1-1cb5173ecd36 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:26.482888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-796f04c9-a1be-4616-98e1-1cb5173ecd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:26.529251 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 74/146] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:26.551301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 73/147] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:26.556087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf054fb1-4195-4422-8c24-2672d15719b6 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:26.658834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf054fb1-4195-4422-8c24-2672d15719b6 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:26.692931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd436079-7acb-4fd7-b9dc-5f040025825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:26.693813 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436079-7acb-4fd7-b9dc-5f040025825e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:26.694320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436079-7acb-4fd7-b9dc-5f040025825e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:26.694785 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436079-7acb-4fd7-b9dc-5f040025825e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:26.705292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd436079-7acb-4fd7-b9dc-5f040025825e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-dd436079-7acb-4fd7-b9dc-5f040025825e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:26.710468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:26.711309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:26.712063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:26.713742 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 75/148] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 12:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 12:59:26.719673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f04c9-a1be-4616-98e1-1cb5173ecd36 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:26.787222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd436079-7acb-4fd7-b9dc-5f040025825e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:26.787660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:26.803346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:26.828173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f04c9-a1be-4616-98e1-1cb5173ecd36 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:26.862932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f74ba-9544-473a-bc8d-3cf120a6b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:26.863559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f74ba-9544-473a-bc8d-3cf120a6b406 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:26.863833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f74ba-9544-473a-bc8d-3cf120a6b406 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:26.864198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f74ba-9544-473a-bc8d-3cf120a6b406 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:26.864943 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f74ba-9544-473a-bc8d-3cf120a6b406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:26.865244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f74ba-9544-473a-bc8d-3cf120a6b406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:26.866645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f74ba-9544-473a-bc8d-3cf120a6b406 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:26.875590 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 74/149] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:26.876425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f74ba-9544-473a-bc8d-3cf120a6b406 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:26.891443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd436079-7acb-4fd7-b9dc-5f040025825e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:26.925719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f83415-3bb0-4079-9637-96857c8e7c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:26.926354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83415-3bb0-4079-9637-96857c8e7c67 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:26.926689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83415-3bb0-4079-9637-96857c8e7c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:26.926959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83415-3bb0-4079-9637-96857c8e7c67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:26.928076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f83415-3bb0-4079-9637-96857c8e7c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:26.929582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f83415-3bb0-4079-9637-96857c8e7c67 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:26.931176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 76/150] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:26.936472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f83415-3bb0-4079-9637-96857c8e7c67 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:26.974405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f74ba-9544-473a-bc8d-3cf120a6b406 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:27.000375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:27.008678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d180b-c2a1-42ab-9ed4-56fc2b7943dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:27.009318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d180b-c2a1-42ab-9ed4-56fc2b7943dd None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:27.009606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d180b-c2a1-42ab-9ed4-56fc2b7943dd None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:27.009869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d180b-c2a1-42ab-9ed4-56fc2b7943dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:27.014772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:27.020386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d180b-c2a1-42ab-9ed4-56fc2b7943dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-1f4d180b-c2a1-42ab-9ed4-56fc2b7943dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:27.025717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:27.026747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 75/151] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 12:59:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:27.027582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d180b-c2a1-42ab-9ed4-56fc2b7943dd None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:27.036358 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f83415-3bb0-4079-9637-96857c8e7c67 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:27.069470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12cd0b-340c-4c03-8628-04c94813257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:27.070123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12cd0b-340c-4c03-8628-04c94813257a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:27.071292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12cd0b-340c-4c03-8628-04c94813257a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:27.071292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12cd0b-340c-4c03-8628-04c94813257a None admin] PATH_INFO: `/v3/users/ad16ebb2d7a34352a662ecee3039a483` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:27.086213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12cd0b-340c-4c03-8628-04c94813257a None admin] RBAC: Authorizing `identity:get_user(user_id=ad16ebb2d7a34352a662ecee3039a483)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:27.087760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12cd0b-340c-4c03-8628-04c94813257a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:27.089480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 77/152] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:26 2022] GET /identity/v3/users/ad16ebb2d7a34352a662ecee3039a483 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:27.094201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12cd0b-340c-4c03-8628-04c94813257a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:27.134161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d180b-c2a1-42ab-9ed4-56fc2b7943dd None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:27.169132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f3ff-0ad9-40c4-bbdd-4266b3a7d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:27.169960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f3ff-0ad9-40c4-bbdd-4266b3a7d0de None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:27.170244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f3ff-0ad9-40c4-bbdd-4266b3a7d0de None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:27.170518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f3ff-0ad9-40c4-bbdd-4266b3a7d0de None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:27.171179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f3ff-0ad9-40c4-bbdd-4266b3a7d0de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:27.172664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f3ff-0ad9-40c4-bbdd-4266b3a7d0de None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:27.189654 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12cd0b-340c-4c03-8628-04c94813257a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:27.195130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 76/153] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:27 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:27.195948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f3ff-0ad9-40c4-bbdd-4266b3a7d0de None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:27.229092 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a2f2d-b9ae-4949-808f-8ff947b31b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:27.229652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2f2d-b9ae-4949-808f-8ff947b31b4e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:27.229935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2f2d-b9ae-4949-808f-8ff947b31b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:27.230212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2f2d-b9ae-4949-808f-8ff947b31b4e None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:27.230936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a2f2d-b9ae-4949-808f-8ff947b31b4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:27.231242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a2f2d-b9ae-4949-808f-8ff947b31b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:27.232710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a2f2d-b9ae-4949-808f-8ff947b31b4e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:27.238768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:27.242763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 78/154] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 12:59:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:27.248980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a2f2d-b9ae-4949-808f-8ff947b31b4e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:27.253099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:27.319642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f3ff-0ad9-40c4-bbdd-4266b3a7d0de None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:27.358255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7364c-3394-4bb3-8b42-1f509e8451b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:27.358917 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7364c-3394-4bb3-8b42-1f509e8451b6 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:27.359199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7364c-3394-4bb3-8b42-1f509e8451b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:27.359474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7364c-3394-4bb3-8b42-1f509e8451b6 None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:27.360724 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7364c-3394-4bb3-8b42-1f509e8451b6 None admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:27.362222 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7364c-3394-4bb3-8b42-1f509e8451b6 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:27.368612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 77/155] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:27 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:27.369625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7364c-3394-4bb3-8b42-1f509e8451b6 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:27.371938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a2f2d-b9ae-4949-808f-8ff947b31b4e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:27.415442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8ef4b-72a6-4d60-95be-23a875db210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:27.416147 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8ef4b-72a6-4d60-95be-23a875db210d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:27.416514 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8ef4b-72a6-4d60-95be-23a875db210d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:27.416779 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8ef4b-72a6-4d60-95be-23a875db210d None admin] PATH_INFO: `/v3/users/ad16ebb2d7a34352a662ecee3039a483` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:27.418922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8ef4b-72a6-4d60-95be-23a875db210d None admin] RBAC: Authorizing `identity:get_user(user_id=ad16ebb2d7a34352a662ecee3039a483)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:27.420414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8ef4b-72a6-4d60-95be-23a875db210d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:27.422025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 79/156] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:27 2022] GET /identity/v3/users/ad16ebb2d7a34352a662ecee3039a483 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:27.428403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8ef4b-72a6-4d60-95be-23a875db210d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:27.487956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7364c-3394-4bb3-8b42-1f509e8451b6 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:27.507467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:27.523238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:27.537157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935425-27e1-49cc-8b29-3422cf67ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:27.538095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935425-27e1-49cc-8b29-3422cf67ea33 None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:27.538516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935425-27e1-49cc-8b29-3422cf67ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:27.539123 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935425-27e1-49cc-8b29-3422cf67ea33 None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e/users/ad16ebb2d7a34352a662ecee3039a483/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:27.542659 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27935425-27e1-49cc-8b29-3422cf67ea33 None admin] RBAC: Authorizing `identity:create_grant(project_id=e11856399ed04d35ad94267285ab565e, user_id=ad16ebb2d7a34352a662ecee3039a483, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:27.544134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27935425-27e1-49cc-8b29-3422cf67ea33 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:27.562235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 78/157] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:27 2022] PUT /identity/v3/projects/e11856399ed04d35ad94267285ab565e/users/ad16ebb2d7a34352a662ecee3039a483/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 12:59:27.578913 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8ef4b-72a6-4d60-95be-23a875db210d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:27.619558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8097892-1e58-4a86-8686-5d252439db3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:27.620323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8097892-1e58-4a86-8686-5d252439db3a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:27.620602 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8097892-1e58-4a86-8686-5d252439db3a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:27.621076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8097892-1e58-4a86-8686-5d252439db3a None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:27.622284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8097892-1e58-4a86-8686-5d252439db3a None admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:27.624213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8097892-1e58-4a86-8686-5d252439db3a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:27.626409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 80/158] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:27 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:27.632749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935425-27e1-49cc-8b29-3422cf67ea33 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:27.747037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935425-27e1-49cc-8b29-3422cf67ea33 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:27.784925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96508e9f-2033-4f8c-9829-ab5b27cb7f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:27.784925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508e9f-2033-4f8c-9829-ab5b27cb7f4b None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:27.785267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508e9f-2033-4f8c-9829-ab5b27cb7f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:27.785267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508e9f-2033-4f8c-9829-ab5b27cb7f4b None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e/users/ad16ebb2d7a34352a662ecee3039a483/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:27.787690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96508e9f-2033-4f8c-9829-ab5b27cb7f4b None admin] RBAC: Authorizing `identity:create_grant(project_id=e11856399ed04d35ad94267285ab565e, user_id=ad16ebb2d7a34352a662ecee3039a483, role_id=e1bfcdd2169d4f49bb8a72e8dd7c33cf)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:27.789215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96508e9f-2033-4f8c-9829-ab5b27cb7f4b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:27.810159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 79/159] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:27 2022] PUT /identity/v3/projects/e11856399ed04d35ad94267285ab565e/users/ad16ebb2d7a34352a662ecee3039a483/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:29.458947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e337b-0553-43fb-b3c6-214d065ece16 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:29.459993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e337b-0553-43fb-b3c6-214d065ece16 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:29.460533 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e337b-0553-43fb-b3c6-214d065ece16 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:29.462116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 81/160] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:29.467603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae722ba2-5d00-4994-a587-b8e38b3fd8b7 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:29.468429 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae722ba2-5d00-4994-a587-b8e38b3fd8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:29.468910 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae722ba2-5d00-4994-a587-b8e38b3fd8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:29.488343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ae722ba2-5d00-4994-a587-b8e38b3fd8b7 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:29.489874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ae722ba2-5d00-4994-a587-b8e38b3fd8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:29.516856 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:29.543226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2194a3-11df-4e21-b93f-34a0b2871013 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:29.543536 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2194a3-11df-4e21-b93f-34a0b2871013 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:29.543769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2194a3-11df-4e21-b93f-34a0b2871013 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:29.545170 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 82/161] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:29.557475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52922-397c-4f2f-8d33-9f530a1cbead None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:29.557755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52922-397c-4f2f-8d33-9f530a1cbead None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:29.558026 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52922-397c-4f2f-8d33-9f530a1cbead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:29.573265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 80/162] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:29.584856 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-97d52922-397c-4f2f-8d33-9f530a1cbead None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:29.586320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-97d52922-397c-4f2f-8d33-9f530a1cbead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:29.657507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 83/163] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:29.779392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0f939-bacd-42b5-8c43-8ff09896e41f None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:29.779691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0f939-bacd-42b5-8c43-8ff09896e41f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:29.779872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0f939-bacd-42b5-8c43-8ff09896e41f None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:29.781286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 81/164] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:29.789781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59483-a51c-4a9c-a7f1-a1f413325563 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:29.790313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59483-a51c-4a9c-a7f1-a1f413325563 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:29.790817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59483-a51c-4a9c-a7f1-a1f413325563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:29.809775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3cc59483-a51c-4a9c-a7f1-a1f413325563 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:29.811305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3cc59483-a51c-4a9c-a7f1-a1f413325563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:29.846558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0f939-bacd-42b5-8c43-8ff09896e41f None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:29.877663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:29.886560 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 84/165] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:29.927307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc59483-a51c-4a9c-a7f1-a1f413325563 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:29.971152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0f939-bacd-42b5-8c43-8ff09896e41f None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.006752 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000620f-d21e-42ea-b6b2-16e8283aeb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.007653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000620f-d21e-42ea-b6b2-16e8283aeb2f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.008126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000620f-d21e-42ea-b6b2-16e8283aeb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.008565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000620f-d21e-42ea-b6b2-16e8283aeb2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.020099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000620f-d21e-42ea-b6b2-16e8283aeb2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-0000620f-d21e-42ea-b6b2-16e8283aeb2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:30.025348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:30.026404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:30.027347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:30.034022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 82/166] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:30.035527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88d742-1ebc-4e68-8cb3-920f25a13d06 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.035846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88d742-1ebc-4e68-8cb3-920f25a13d06 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.036121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88d742-1ebc-4e68-8cb3-920f25a13d06 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.037518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 83/167] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:30.038918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88d742-1ebc-4e68-8cb3-920f25a13d06 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.046806 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc59483-a51c-4a9c-a7f1-a1f413325563 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.063885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:30.085190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa74d2f-7682-45d3-8f38-2c298e68e571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.085837 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa74d2f-7682-45d3-8f38-2c298e68e571 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.086427 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa74d2f-7682-45d3-8f38-2c298e68e571 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.086702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa74d2f-7682-45d3-8f38-2c298e68e571 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.087964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa74d2f-7682-45d3-8f38-2c298e68e571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:30.089459 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa74d2f-7682-45d3-8f38-2c298e68e571 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:30.091057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 85/168] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:30.092226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea6cdc-6587-428d-ae3f-9ce13927c073 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.092538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea6cdc-6587-428d-ae3f-9ce13927c073 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.092811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea6cdc-6587-428d-ae3f-9ce13927c073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.111429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4eea6cdc-6587-428d-ae3f-9ce13927c073 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:30.112653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4eea6cdc-6587-428d-ae3f-9ce13927c073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:30.149089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88d742-1ebc-4e68-8cb3-920f25a13d06 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.171832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:30.180932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 86/169] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:30.181725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea6cdc-6587-428d-ae3f-9ce13927c073 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.183046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932c628-8977-4b41-9fc4-f97f6b00c5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.183659 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932c628-8977-4b41-9fc4-f97f6b00c5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.183935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932c628-8977-4b41-9fc4-f97f6b00c5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.184198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932c628-8977-4b41-9fc4-f97f6b00c5b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.184902 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932c628-8977-4b41-9fc4-f97f6b00c5b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:30.185205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932c628-8977-4b41-9fc4-f97f6b00c5b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:30.186579 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932c628-8977-4b41-9fc4-f97f6b00c5b5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:30.199410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 84/170] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:30.199410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932c628-8977-4b41-9fc4-f97f6b00c5b5 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.281973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea6cdc-6587-428d-ae3f-9ce13927c073 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.288813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:30.305820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932c628-8977-4b41-9fc4-f97f6b00c5b5 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.317631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb19d9-91fd-4471-845d-879cbc0e213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.318258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb19d9-91fd-4471-845d-879cbc0e213d None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.318534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb19d9-91fd-4471-845d-879cbc0e213d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.318811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb19d9-91fd-4471-845d-879cbc0e213d None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.319463 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb19d9-91fd-4471-845d-879cbc0e213d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:30.321068 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb19d9-91fd-4471-845d-879cbc0e213d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:30.341154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e182-7aa5-4f58-a0df-fe2b797ae7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.341781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e182-7aa5-4f58-a0df-fe2b797ae7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.342314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e182-7aa5-4f58-a0df-fe2b797ae7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.342423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 87/171] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:30 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:30.343018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb19d9-91fd-4471-845d-879cbc0e213d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.352719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e182-7aa5-4f58-a0df-fe2b797ae7a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.371001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7e182-7aa5-4f58-a0df-fe2b797ae7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-05d7e182-7aa5-4f58-a0df-fe2b797ae7a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:30.381497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:30.382643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:30.383594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:30.386379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 85/172] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 12:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:30.393415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e182-7aa5-4f58-a0df-fe2b797ae7a7 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.411128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:30.478561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb19d9-91fd-4471-845d-879cbc0e213d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.511587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e182-7aa5-4f58-a0df-fe2b797ae7a7 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.523081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569fd1-61f1-48d3-a3b2-0081d2263136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.523728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569fd1-61f1-48d3-a3b2-0081d2263136 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.524065 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569fd1-61f1-48d3-a3b2-0081d2263136 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.524396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569fd1-61f1-48d3-a3b2-0081d2263136 None admin] PATH_INFO: `/v3/users/54ba7b540f294d3a8773a93b2bf8e793` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.540760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01569fd1-61f1-48d3-a3b2-0081d2263136 None admin] RBAC: Authorizing `identity:get_user(user_id=54ba7b540f294d3a8773a93b2bf8e793)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:30.542186 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01569fd1-61f1-48d3-a3b2-0081d2263136 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:30.544201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 88/173] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:30 2022] GET /identity/v3/users/54ba7b540f294d3a8773a93b2bf8e793 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:30.545030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569fd1-61f1-48d3-a3b2-0081d2263136 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.553013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4bc5-3e20-4dbc-8db6-050ba703060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.554062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4bc5-3e20-4dbc-8db6-050ba703060f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.554343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4bc5-3e20-4dbc-8db6-050ba703060f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.554647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4bc5-3e20-4dbc-8db6-050ba703060f None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.555347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d4bc5-3e20-4dbc-8db6-050ba703060f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:30.555647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d4bc5-3e20-4dbc-8db6-050ba703060f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:30.557186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d4bc5-3e20-4dbc-8db6-050ba703060f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:30.567439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 86/174] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:30.569158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4bc5-3e20-4dbc-8db6-050ba703060f None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.578919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:30.670316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569fd1-61f1-48d3-a3b2-0081d2263136 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.680559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:30.691406 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4bc5-3e20-4dbc-8db6-050ba703060f None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.708728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a6aca-b823-4d61-a5da-0680ef3544d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.709378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a6aca-b823-4d61-a5da-0680ef3544d9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.709662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a6aca-b823-4d61-a5da-0680ef3544d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.709942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a6aca-b823-4d61-a5da-0680ef3544d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.728265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a6aca-b823-4d61-a5da-0680ef3544d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-291a6aca-b823-4d61-a5da-0680ef3544d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:30.733868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:30.734892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 89/175] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 12:59:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:30.735873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a6aca-b823-4d61-a5da-0680ef3544d9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.737718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce649e96-a3ca-4d6d-b027-ee1b3a083c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.740725 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce649e96-a3ca-4d6d-b027-ee1b3a083c8f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.741010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce649e96-a3ca-4d6d-b027-ee1b3a083c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.741287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce649e96-a3ca-4d6d-b027-ee1b3a083c8f None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.742660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce649e96-a3ca-4d6d-b027-ee1b3a083c8f None admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:30.745151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce649e96-a3ca-4d6d-b027-ee1b3a083c8f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:30.747081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 87/176] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:30 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:30.748436 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce649e96-a3ca-4d6d-b027-ee1b3a083c8f None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.842884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a6aca-b823-4d61-a5da-0680ef3544d9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.844209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:30.876520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce649e96-a3ca-4d6d-b027-ee1b3a083c8f None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:30.877043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960814a4-eb07-48a8-83ee-a376f8c081d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.877817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960814a4-eb07-48a8-83ee-a376f8c081d6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.878196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960814a4-eb07-48a8-83ee-a376f8c081d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.878577 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960814a4-eb07-48a8-83ee-a376f8c081d6 None admin] PATH_INFO: `/v3/users/ad16ebb2d7a34352a662ecee3039a483` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.880278 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960814a4-eb07-48a8-83ee-a376f8c081d6 None admin] RBAC: Authorizing `identity:get_user(user_id=ad16ebb2d7a34352a662ecee3039a483)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:30.881858 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960814a4-eb07-48a8-83ee-a376f8c081d6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:30.883601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 90/177] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:30 2022] GET /identity/v3/users/ad16ebb2d7a34352a662ecee3039a483 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:30.885638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960814a4-eb07-48a8-83ee-a376f8c081d6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.917173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a981f-a427-47be-b698-3996bb46e83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:30.918045 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a981f-a427-47be-b698-3996bb46e83c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:30.918334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a981f-a427-47be-b698-3996bb46e83c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:30.918613 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a981f-a427-47be-b698-3996bb46e83c None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:30.919435 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a981f-a427-47be-b698-3996bb46e83c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:30.919742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a981f-a427-47be-b698-3996bb46e83c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:30.921744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a981f-a427-47be-b698-3996bb46e83c None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:30.937220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 88/178] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 12:59:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:30.938425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a981f-a427-47be-b698-3996bb46e83c None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:30.972713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:30.993109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960814a4-eb07-48a8-83ee-a376f8c081d6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:31.032024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2a85e-9083-48ae-8ba8-d488d2634b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:31.032731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a85e-9083-48ae-8ba8-d488d2634b23 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:31.033007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a85e-9083-48ae-8ba8-d488d2634b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:31.033279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a85e-9083-48ae-8ba8-d488d2634b23 None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e/users/54ba7b540f294d3a8773a93b2bf8e793/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:31.035987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2a85e-9083-48ae-8ba8-d488d2634b23 None admin] RBAC: Authorizing `identity:create_grant(project_id=e11856399ed04d35ad94267285ab565e, user_id=54ba7b540f294d3a8773a93b2bf8e793, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:31.037885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2a85e-9083-48ae-8ba8-d488d2634b23 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:31.056827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 91/179] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:30 2022] PUT /identity/v3/projects/e11856399ed04d35ad94267285ab565e/users/54ba7b540f294d3a8773a93b2bf8e793/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:31.057888 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2a85e-9083-48ae-8ba8-d488d2634b23 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:31.060600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a981f-a427-47be-b698-3996bb46e83c None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:31.106519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de61139-1fb9-4e32-a0e0-f9290736aa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:31.107596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de61139-1fb9-4e32-a0e0-f9290736aa7c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:31.107984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de61139-1fb9-4e32-a0e0-f9290736aa7c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:31.109448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de61139-1fb9-4e32-a0e0-f9290736aa7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:31.114908 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:31.229960 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:31.243947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2a85e-9083-48ae-8ba8-d488d2634b23 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:31.252902 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de61139-1fb9-4e32-a0e0-f9290736aa7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:31.257140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de61139-1fb9-4e32-a0e0-f9290736aa7c None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:31.311422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d364ed-72d6-48bf-b915-3c6c2f012568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:31.312181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d364ed-72d6-48bf-b915-3c6c2f012568 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:31.312493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d364ed-72d6-48bf-b915-3c6c2f012568 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:31.312777 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d364ed-72d6-48bf-b915-3c6c2f012568 None admin] PATH_INFO: `/v3/users/ad16ebb2d7a34352a662ecee3039a483` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:31.313944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d364ed-72d6-48bf-b915-3c6c2f012568 None admin] RBAC: Authorizing `identity:get_user(user_id=ad16ebb2d7a34352a662ecee3039a483)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:31.315479 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d364ed-72d6-48bf-b915-3c6c2f012568 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:31.317769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 92/180] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:31 2022] GET /identity/v3/users/ad16ebb2d7a34352a662ecee3039a483 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:31.324217 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d364ed-72d6-48bf-b915-3c6c2f012568 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:31.403521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 89/181] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 12:59:31.412954 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de61139-1fb9-4e32-a0e0-f9290736aa7c None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:31.452983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:31.507830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d364ed-72d6-48bf-b915-3c6c2f012568 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:31.577890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094cfd6-1c62-4296-8e12-145da80de6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:31.580160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de61139-1fb9-4e32-a0e0-f9290736aa7c None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:31.581862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094cfd6-1c62-4296-8e12-145da80de6ca None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:31.582136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094cfd6-1c62-4296-8e12-145da80de6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:31.582402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094cfd6-1c62-4296-8e12-145da80de6ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:31.636149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161acad-1f82-4811-a3f8-2bf74e0298a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:31.636815 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161acad-1f82-4811-a3f8-2bf74e0298a3 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:31.637090 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161acad-1f82-4811-a3f8-2bf74e0298a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:31.637359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161acad-1f82-4811-a3f8-2bf74e0298a3 None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:31.638590 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161acad-1f82-4811-a3f8-2bf74e0298a3 None admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:31.643909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161acad-1f82-4811-a3f8-2bf74e0298a3 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:31.645894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 90/182] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:31 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:31.647104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:31.654614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161acad-1f82-4811-a3f8-2bf74e0298a3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:31.718340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094cfd6-1c62-4296-8e12-145da80de6ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:31.719830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094cfd6-1c62-4296-8e12-145da80de6ca None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:31.816325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161acad-1f82-4811-a3f8-2bf74e0298a3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:31.816325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:31.848775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371132-05d4-444a-b5a1-d8d5ff6c592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:31.849390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371132-05d4-444a-b5a1-d8d5ff6c592a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:31.849665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371132-05d4-444a-b5a1-d8d5ff6c592a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:31.853288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371132-05d4-444a-b5a1-d8d5ff6c592a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:31.853288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371132-05d4-444a-b5a1-d8d5ff6c592a None admin] RBAC: Adding query filter params (role.id=67447f88528849c59df641acc7768c92, scope.project.id=e11856399ed04d35ad94267285ab565e, user.id=ad16ebb2d7a34352a662ecee3039a483) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:31.853288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371132-05d4-444a-b5a1-d8d5ff6c592a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:31.853288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371132-05d4-444a-b5a1-d8d5ff6c592a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:31.859867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 91/183] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 12:59:31 2022] GET /identity/v3/role_assignments?user.id=ad16ebb2d7a34352a662ecee3039a483&scope.project.id=e11856399ed04d35ad94267285ab565e&role.id=67447f88528849c59df641acc7768c92 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:31.912642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 93/184] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 12:59:31.921557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371132-05d4-444a-b5a1-d8d5ff6c592a None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:32.065304 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371132-05d4-444a-b5a1-d8d5ff6c592a None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:32.109400 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04727e64-5f44-4773-9e81-5fdc4ef22b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:32.110321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04727e64-5f44-4773-9e81-5fdc4ef22b39 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:32.110767 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04727e64-5f44-4773-9e81-5fdc4ef22b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:32.111193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04727e64-5f44-4773-9e81-5fdc4ef22b39 None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:32.117146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04727e64-5f44-4773-9e81-5fdc4ef22b39 None admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:32.118838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04727e64-5f44-4773-9e81-5fdc4ef22b39 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:32.121167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 92/185] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:31 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:32.127304 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094cfd6-1c62-4296-8e12-145da80de6ca None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:32.219463 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:32.260221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094cfd6-1c62-4296-8e12-145da80de6ca None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:32.295489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95eb18-46fa-4f94-83bf-7aaaf113a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:32.296108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95eb18-46fa-4f94-83bf-7aaaf113a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:32.296410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95eb18-46fa-4f94-83bf-7aaaf113a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:32.296682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95eb18-46fa-4f94-83bf-7aaaf113a1e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:32.297417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95eb18-46fa-4f94-83bf-7aaaf113a1e3 None admin] RBAC: Adding query filter params (role.id=e1bfcdd2169d4f49bb8a72e8dd7c33cf, scope.project.id=e11856399ed04d35ad94267285ab565e, user.id=ad16ebb2d7a34352a662ecee3039a483) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:32.297722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95eb18-46fa-4f94-83bf-7aaaf113a1e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:32.299165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95eb18-46fa-4f94-83bf-7aaaf113a1e3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:32.305333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 94/186] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 12:59:32 2022] GET /identity/v3/role_assignments?user.id=ad16ebb2d7a34352a662ecee3039a483&scope.project.id=e11856399ed04d35ad94267285ab565e&role.id=e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:32.719330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e02e-97f3-446d-9b4b-c301702f91b4 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:32.719875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e02e-97f3-446d-9b4b-c301702f91b4 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:32.719875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e02e-97f3-446d-9b4b-c301702f91b4 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:32.721415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 93/187] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:32.726816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73ce78-9fe5-48d0-b323-ffb53cc8f22e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:32.727248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73ce78-9fe5-48d0-b323-ffb53cc8f22e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:32.727323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73ce78-9fe5-48d0-b323-ffb53cc8f22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:32.746150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5f73ce78-9fe5-48d0-b323-ffb53cc8f22e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:32.747335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5f73ce78-9fe5-48d0-b323-ffb53cc8f22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:32.817222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 95/188] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:32.959410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb89ce7-9c66-48ed-9776-e5ae01fcb43f None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:32.959745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb89ce7-9c66-48ed-9776-e5ae01fcb43f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:32.959965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb89ce7-9c66-48ed-9776-e5ae01fcb43f None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:32.961517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 94/189] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:32.967060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb0d1c-95f5-4a1b-abac-9759c3f87175 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:32.967353 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb0d1c-95f5-4a1b-abac-9759c3f87175 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:32.967656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb0d1c-95f5-4a1b-abac-9759c3f87175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:32.988185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d0eb0d1c-95f5-4a1b-abac-9759c3f87175 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:32.989501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d0eb0d1c-95f5-4a1b-abac-9759c3f87175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:33.053883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:33.072410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 96/190] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:33.088869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb89ce7-9c66-48ed-9776-e5ae01fcb43f None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:33.127308 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:33.193721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb89ce7-9c66-48ed-9776-e5ae01fcb43f None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:33.227238 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1391c2-ad86-4324-9d8c-93659b4c5886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:33.227879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1391c2-ad86-4324-9d8c-93659b4c5886 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:33.228160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1391c2-ad86-4324-9d8c-93659b4c5886 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:33.228469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1391c2-ad86-4324-9d8c-93659b4c5886 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:33.238906 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1391c2-ad86-4324-9d8c-93659b4c5886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-db1391c2-ad86-4324-9d8c-93659b4c5886 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:33.244252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:33.245132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:33.245919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 95/191] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 12:59:33.251554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb0d1c-95f5-4a1b-abac-9759c3f87175 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:33.348899 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1391c2-ad86-4324-9d8c-93659b4c5886 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:33.361614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb0d1c-95f5-4a1b-abac-9759c3f87175 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:33.405761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646b0c5-e98e-4316-9aa3-1a4013448632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:33.406397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646b0c5-e98e-4316-9aa3-1a4013448632 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:33.406679 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646b0c5-e98e-4316-9aa3-1a4013448632 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:33.406955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646b0c5-e98e-4316-9aa3-1a4013448632 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:33.407644 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646b0c5-e98e-4316-9aa3-1a4013448632 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:33.407951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646b0c5-e98e-4316-9aa3-1a4013448632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:33.409998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646b0c5-e98e-4316-9aa3-1a4013448632 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:33.419629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 97/192] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:33.425338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646b0c5-e98e-4316-9aa3-1a4013448632 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:33.460331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:33.466566 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1391c2-ad86-4324-9d8c-93659b4c5886 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:33.480133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:33.503827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c5419-9f8c-4308-b298-5002947e2b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:33.504413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c5419-9f8c-4308-b298-5002947e2b4d None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:33.504761 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c5419-9f8c-4308-b298-5002947e2b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:33.505037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c5419-9f8c-4308-b298-5002947e2b4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:33.506170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c5419-9f8c-4308-b298-5002947e2b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:33.507766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c5419-9f8c-4308-b298-5002947e2b4d None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:33.512610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 96/193] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:33.515183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c5419-9f8c-4308-b298-5002947e2b4d None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:33.535279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646b0c5-e98e-4316-9aa3-1a4013448632 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:33.568778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69c5c2-cfd5-4ccb-9afd-4c857e7e93f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:33.569429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c5c2-cfd5-4ccb-9afd-4c857e7e93f2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:33.569714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c5c2-cfd5-4ccb-9afd-4c857e7e93f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:33.569979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c5c2-cfd5-4ccb-9afd-4c857e7e93f2 None admin] PATH_INFO: `/v3/users/e282d48e0b1e4ef990e5cae26d6eea48` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:33.582747 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69c5c2-cfd5-4ccb-9afd-4c857e7e93f2 None admin] RBAC: Authorizing `identity:get_user(user_id=e282d48e0b1e4ef990e5cae26d6eea48)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:33.584220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69c5c2-cfd5-4ccb-9afd-4c857e7e93f2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:33.590557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 98/194] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:33 2022] GET /identity/v3/users/e282d48e0b1e4ef990e5cae26d6eea48 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:33.590557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68925a91-dc0f-4899-8f4f-704d3fb2b4b1 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:33.590557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68925a91-dc0f-4899-8f4f-704d3fb2b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:33.590557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68925a91-dc0f-4899-8f4f-704d3fb2b4b1 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:33.590557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 99/195] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:33.593101 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68925a91-dc0f-4899-8f4f-704d3fb2b4b1 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:33.616452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c5419-9f8c-4308-b298-5002947e2b4d None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:33.648728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b67a-2a83-4636-a82f-f6e03e279564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:33.649334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b67a-2a83-4636-a82f-f6e03e279564 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:33.649633 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b67a-2a83-4636-a82f-f6e03e279564 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:33.649879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b67a-2a83-4636-a82f-f6e03e279564 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:33.650536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8b67a-2a83-4636-a82f-f6e03e279564 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:33.651977 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8b67a-2a83-4636-a82f-f6e03e279564 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:33.674988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 97/196] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:33 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:33.686545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd5d14-e949-45e9-90ed-7c98d3b1a1ce None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:33.686949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd5d14-e949-45e9-90ed-7c98d3b1a1ce None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:33.687369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd5d14-e949-45e9-90ed-7c98d3b1a1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:33.693714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68925a91-dc0f-4899-8f4f-704d3fb2b4b1 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:33.704998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:33.711603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-befd5d14-e949-45e9-90ed-7c98d3b1a1ce None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:33.714002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-befd5d14-e949-45e9-90ed-7c98d3b1a1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:33.733583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:33.734540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd3d15-a3fd-4b35-bcb7-3813f9cdb250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:33.735202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3d15-a3fd-4b35-bcb7-3813f9cdb250 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:33.735516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3d15-a3fd-4b35-bcb7-3813f9cdb250 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:33.735820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3d15-a3fd-4b35-bcb7-3813f9cdb250 None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:33.737228 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd3d15-a3fd-4b35-bcb7-3813f9cdb250 None admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:33.738801 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd3d15-a3fd-4b35-bcb7-3813f9cdb250 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:33.740753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 100/197] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:33 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:33.746995 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd3d15-a3fd-4b35-bcb7-3813f9cdb250 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:33.807799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 98/198] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:33.858582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd3d15-a3fd-4b35-bcb7-3813f9cdb250 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:33.896604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77b06-b7c9-4483-b875-c76bb522278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:33.897273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77b06-b7c9-4483-b875-c76bb522278d None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:33.897555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77b06-b7c9-4483-b875-c76bb522278d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:33.897827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77b06-b7c9-4483-b875-c76bb522278d None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e/users/e282d48e0b1e4ef990e5cae26d6eea48/roles/c1842e25399a42b980fe646bb06ac0d9` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:33.899732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d77b06-b7c9-4483-b875-c76bb522278d None admin] RBAC: Authorizing `identity:create_grant(project_id=e11856399ed04d35ad94267285ab565e, user_id=e282d48e0b1e4ef990e5cae26d6eea48, role_id=c1842e25399a42b980fe646bb06ac0d9)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:33.901213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d77b06-b7c9-4483-b875-c76bb522278d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:33.916375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 101/199] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 12:59:33 2022] PUT /identity/v3/projects/e11856399ed04d35ad94267285ab565e/users/e282d48e0b1e4ef990e5cae26d6eea48/roles/c1842e25399a42b980fe646bb06ac0d9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 12:59:34.074023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd5d14-e949-45e9-90ed-7c98d3b1a1ce None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:34.175426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd5d14-e949-45e9-90ed-7c98d3b1a1ce None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:34.210485 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d3826-d4a3-4cad-8446-efc20c9ba124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:34.211541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d3826-d4a3-4cad-8446-efc20c9ba124 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:34.212030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d3826-d4a3-4cad-8446-efc20c9ba124 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:34.212514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d3826-d4a3-4cad-8446-efc20c9ba124 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:34.223006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d3826-d4a3-4cad-8446-efc20c9ba124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-832d3826-d4a3-4cad-8446-efc20c9ba124 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:34.228150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:34.229172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:34.229948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:34.236654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 99/200] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:34.238717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77b06-b7c9-4483-b875-c76bb522278d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:34.275177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:34.346062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77b06-b7c9-4483-b875-c76bb522278d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:34.380772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9e8be-88c8-41c6-91a3-0f340136eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:34.381403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9e8be-88c8-41c6-91a3-0f340136eb8c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:34.381682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9e8be-88c8-41c6-91a3-0f340136eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:34.381954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9e8be-88c8-41c6-91a3-0f340136eb8c None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:34.382629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9e8be-88c8-41c6-91a3-0f340136eb8c None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:34.382929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9e8be-88c8-41c6-91a3-0f340136eb8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:34.384344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9e8be-88c8-41c6-91a3-0f340136eb8c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:34.392779 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 102/201] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:34.398941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d3826-d4a3-4cad-8446-efc20c9ba124 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:34.412268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:34.505968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d3826-d4a3-4cad-8446-efc20c9ba124 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:34.541642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f592aa-0e15-4cc8-9b11-b6a9128c9061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:34.542298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f592aa-0e15-4cc8-9b11-b6a9128c9061 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:34.542582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f592aa-0e15-4cc8-9b11-b6a9128c9061 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:34.542860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f592aa-0e15-4cc8-9b11-b6a9128c9061 None admin] PATH_INFO: `/v3/users/54ba7b540f294d3a8773a93b2bf8e793` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:34.544007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f592aa-0e15-4cc8-9b11-b6a9128c9061 None admin] RBAC: Authorizing `identity:get_user(user_id=54ba7b540f294d3a8773a93b2bf8e793)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:34.545527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f592aa-0e15-4cc8-9b11-b6a9128c9061 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:34.547313 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 100/202] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:34 2022] GET /identity/v3/users/54ba7b540f294d3a8773a93b2bf8e793 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:34.552893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9e8be-88c8-41c6-91a3-0f340136eb8c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:34.653451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:34.657570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9e8be-88c8-41c6-91a3-0f340136eb8c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:34.693490 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a2125-0d36-4065-85dc-a8b835c2b85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:34.694116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2125-0d36-4065-85dc-a8b835c2b85c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:34.694410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2125-0d36-4065-85dc-a8b835c2b85c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:34.694672 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2125-0d36-4065-85dc-a8b835c2b85c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:34.770843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a2125-0d36-4065-85dc-a8b835c2b85c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:34.772498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a2125-0d36-4065-85dc-a8b835c2b85c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:34.874350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:34.879147 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 103/203] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 12:59:34.885073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f592aa-0e15-4cc8-9b11-b6a9128c9061 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:34.965082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:34.987472 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f592aa-0e15-4cc8-9b11-b6a9128c9061 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:35.022800 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60c24-e146-467b-add9-713e7a9953cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:35.023447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60c24-e146-467b-add9-713e7a9953cd None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:35.023732 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60c24-e146-467b-add9-713e7a9953cd None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:35.024011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60c24-e146-467b-add9-713e7a9953cd None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:35.025173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60c24-e146-467b-add9-713e7a9953cd None admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:35.026634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60c24-e146-467b-add9-713e7a9953cd None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:35.032648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 101/204] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:34 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:35.034545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a2125-0d36-4065-85dc-a8b835c2b85c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:35.140922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a2125-0d36-4065-85dc-a8b835c2b85c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:35.175865 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97234fdb-6325-455c-af51-3cb4dd699da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:35.176584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234fdb-6325-455c-af51-3cb4dd699da4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:35.176863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234fdb-6325-455c-af51-3cb4dd699da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:35.177130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234fdb-6325-455c-af51-3cb4dd699da4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:35.177884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97234fdb-6325-455c-af51-3cb4dd699da4 None admin] RBAC: Adding query filter params (role.id=5a473059a779480ca6031449b18aeb52, scope.project.id=e11856399ed04d35ad94267285ab565e, user.id=54ba7b540f294d3a8773a93b2bf8e793) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:35.178213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97234fdb-6325-455c-af51-3cb4dd699da4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:35.179671 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97234fdb-6325-455c-af51-3cb4dd699da4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:35.186095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 104/205] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 12:59:35 2022] GET /identity/v3/role_assignments?user.id=54ba7b540f294d3a8773a93b2bf8e793&scope.project.id=e11856399ed04d35ad94267285ab565e&role.id=5a473059a779480ca6031449b18aeb52 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:36.025208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef608-18ca-4e1b-b83a-d9b9f87797f3 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.025743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef608-18ca-4e1b-b83a-d9b9f87797f3 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.025743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef608-18ca-4e1b-b83a-d9b9f87797f3 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.027236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 102/206] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:36.033631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc51d6-fa5a-4353-b805-8858ec77153a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.034169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc51d6-fa5a-4353-b805-8858ec77153a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.034169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc51d6-fa5a-4353-b805-8858ec77153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.053796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-14bc51d6-fa5a-4353-b805-8858ec77153a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:36.054999 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-14bc51d6-fa5a-4353-b805-8858ec77153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:36.082780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c4df7-a77b-444c-b854-131ccdcf92ce None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.083341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c4df7-a77b-444c-b854-131ccdcf92ce None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.083653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c4df7-a77b-444c-b854-131ccdcf92ce None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.085177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 103/207] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:36.090538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217311-dbca-4700-8635-111ea1460afe None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.090822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217311-dbca-4700-8635-111ea1460afe None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.091098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217311-dbca-4700-8635-111ea1460afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.109272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b1217311-dbca-4700-8635-111ea1460afe None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:36.110381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b1217311-dbca-4700-8635-111ea1460afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:36.114638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:36.126904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 105/208] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:36.130952 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acf2bd-f322-4486-9051-5f04b2cae442 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.131233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acf2bd-f322-4486-9051-5f04b2cae442 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.131501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acf2bd-f322-4486-9051-5f04b2cae442 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.132940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 106/209] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:36.137610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240188d-6c20-405e-91c8-0e1105f995ee None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.137877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240188d-6c20-405e-91c8-0e1105f995ee None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.138148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240188d-6c20-405e-91c8-0e1105f995ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.156138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a240188d-6c20-405e-91c8-0e1105f995ee None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:36.157350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a240188d-6c20-405e-91c8-0e1105f995ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:36.183127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 104/210] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:36.227761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 107/211] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:36.392047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1217311-dbca-4700-8635-111ea1460afe None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:36.445135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240188d-6c20-405e-91c8-0e1105f995ee None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:36.475854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:36.501108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1217311-dbca-4700-8635-111ea1460afe None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:36.534448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966f546-27d1-4d4a-bf7d-c743d2d1b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:36.535083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966f546-27d1-4d4a-bf7d-c743d2d1b482 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.535365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966f546-27d1-4d4a-bf7d-c743d2d1b482 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.535642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966f546-27d1-4d4a-bf7d-c743d2d1b482 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.545885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966f546-27d1-4d4a-bf7d-c743d2d1b482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-b966f546-27d1-4d4a-bf7d-c743d2d1b482 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:36.550858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:36.551788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:36.552628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 105/212] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:36.553834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240188d-6c20-405e-91c8-0e1105f995ee None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:36.554081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966f546-27d1-4d4a-bf7d-c743d2d1b482 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:36.576713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:36.589220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bee47-c08c-42ce-a6cf-3e6827102878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:36.590075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bee47-c08c-42ce-a6cf-3e6827102878 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.590356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bee47-c08c-42ce-a6cf-3e6827102878 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.590631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bee47-c08c-42ce-a6cf-3e6827102878 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.591736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bee47-c08c-42ce-a6cf-3e6827102878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:36.593232 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bee47-c08c-42ce-a6cf-3e6827102878 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:36.594825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 108/213] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:36.598062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bee47-c08c-42ce-a6cf-3e6827102878 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:36.658778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966f546-27d1-4d4a-bf7d-c743d2d1b482 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:36.692616 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835087f-a08b-4c6a-9edc-95ac0025696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:36.692778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bee47-c08c-42ce-a6cf-3e6827102878 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:36.693287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835087f-a08b-4c6a-9edc-95ac0025696c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.693565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835087f-a08b-4c6a-9edc-95ac0025696c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.693831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835087f-a08b-4c6a-9edc-95ac0025696c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.696514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:36.704783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835087f-a08b-4c6a-9edc-95ac0025696c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-8835087f-a08b-4c6a-9edc-95ac0025696c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:36.709647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:36.710558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:36.711345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 106/214] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:36.711992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835087f-a08b-4c6a-9edc-95ac0025696c None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:36.729183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d32b7-eca2-45b2-9a46-7accd29bd6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:36.729827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d32b7-eca2-45b2-9a46-7accd29bd6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.730115 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d32b7-eca2-45b2-9a46-7accd29bd6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.730381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d32b7-eca2-45b2-9a46-7accd29bd6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.731054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d32b7-eca2-45b2-9a46-7accd29bd6d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:36.731358 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d32b7-eca2-45b2-9a46-7accd29bd6d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:36.732900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d32b7-eca2-45b2-9a46-7accd29bd6d3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:36.741139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 109/215] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:36.741984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d32b7-eca2-45b2-9a46-7accd29bd6d3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:36.792073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:36.811938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835087f-a08b-4c6a-9edc-95ac0025696c None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:36.838284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d32b7-eca2-45b2-9a46-7accd29bd6d3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:36.848564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360f007-e8c4-4fb4-b5b8-2de61e8ed3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:36.849186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f007-e8c4-4fb4-b5b8-2de61e8ed3ce None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.849471 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f007-e8c4-4fb4-b5b8-2de61e8ed3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.849741 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f007-e8c4-4fb4-b5b8-2de61e8ed3ce None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.850413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360f007-e8c4-4fb4-b5b8-2de61e8ed3ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:36.851889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360f007-e8c4-4fb4-b5b8-2de61e8ed3ce None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:36.872454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718026c5-d19d-4b12-b05e-b0e5ce2f180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:36.873432 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718026c5-d19d-4b12-b05e-b0e5ce2f180d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:36.873711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718026c5-d19d-4b12-b05e-b0e5ce2f180d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:36.873961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 107/216] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:36 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:36.874060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718026c5-d19d-4b12-b05e-b0e5ce2f180d None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:36.874629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718026c5-d19d-4b12-b05e-b0e5ce2f180d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:36.874785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360f007-e8c4-4fb4-b5b8-2de61e8ed3ce None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:36.874930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718026c5-d19d-4b12-b05e-b0e5ce2f180d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:36.876420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718026c5-d19d-4b12-b05e-b0e5ce2f180d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:36.885391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 110/217] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:36.891646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718026c5-d19d-4b12-b05e-b0e5ce2f180d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:36.945526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:37.002198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360f007-e8c4-4fb4-b5b8-2de61e8ed3ce None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:37.007970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718026c5-d19d-4b12-b05e-b0e5ce2f180d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:37.023094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:37.043933 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef3dd0-3dc2-43fc-afd2-4c66b832b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:37.044670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a34da8-84bd-4c72-a045-52f74fa6e3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:37.045022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef3dd0-3dc2-43fc-afd2-4c66b832b798 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:37.045107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34da8-84bd-4c72-a045-52f74fa6e3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:37.045176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef3dd0-3dc2-43fc-afd2-4c66b832b798 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:37.045242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34da8-84bd-4c72-a045-52f74fa6e3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:37.045315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef3dd0-3dc2-43fc-afd2-4c66b832b798 None admin] PATH_INFO: `/v3/users/e282d48e0b1e4ef990e5cae26d6eea48` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:37.045383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34da8-84bd-4c72-a045-52f74fa6e3f3 None admin] PATH_INFO: `/v3/users/dc3aec4430a8436dbf65e3045f2af4e4` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:37.046364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef3dd0-3dc2-43fc-afd2-4c66b832b798 None admin] RBAC: Authorizing `identity:get_user(user_id=e282d48e0b1e4ef990e5cae26d6eea48)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:37.047829 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef3dd0-3dc2-43fc-afd2-4c66b832b798 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:37.052321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 111/218] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:36 2022] GET /identity/v3/users/e282d48e0b1e4ef990e5cae26d6eea48 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:37.055272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef3dd0-3dc2-43fc-afd2-4c66b832b798 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:37.065070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a34da8-84bd-4c72-a045-52f74fa6e3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=dc3aec4430a8436dbf65e3045f2af4e4)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:37.066564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a34da8-84bd-4c72-a045-52f74fa6e3f3 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:37.068415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 108/219] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:36 2022] GET /identity/v3/users/dc3aec4430a8436dbf65e3045f2af4e4 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:37.075109 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a34da8-84bd-4c72-a045-52f74fa6e3f3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:37.185105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef3dd0-3dc2-43fc-afd2-4c66b832b798 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:37.192559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a34da8-84bd-4c72-a045-52f74fa6e3f3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:37.205635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:37.225058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8bac7-f196-4372-8345-7356f157a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:37.226293 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8bac7-f196-4372-8345-7356f157a112 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:37.226293 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8bac7-f196-4372-8345-7356f157a112 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:37.226293 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8bac7-f196-4372-8345-7356f157a112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:37.238318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29637c66-e24b-4b98-8d8d-d28d8e386db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:37.239107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29637c66-e24b-4b98-8d8d-d28d8e386db6 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:37.239387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29637c66-e24b-4b98-8d8d-d28d8e386db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:37.239660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29637c66-e24b-4b98-8d8d-d28d8e386db6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:37.240452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29637c66-e24b-4b98-8d8d-d28d8e386db6 None admin] RBAC: Adding query filter params (role.id=5a473059a779480ca6031449b18aeb52, user.id=dc3aec4430a8436dbf65e3045f2af4e4, scope.system=all) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:37.240762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29637c66-e24b-4b98-8d8d-d28d8e386db6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:37.242747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29637c66-e24b-4b98-8d8d-d28d8e386db6 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:37.251287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 109/220] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Oct 24 12:59:37 2022] GET /identity/v3/role_assignments?user.id=dc3aec4430a8436dbf65e3045f2af4e4&scope.system=all&role.id=5a473059a779480ca6031449b18aeb52 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:37.293099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:37.315613 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8bac7-f196-4372-8345-7356f157a112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:37.317218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8bac7-f196-4372-8345-7356f157a112 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:37.431073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 112/221] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 12:59:37.437164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29637c66-e24b-4b98-8d8d-d28d8e386db6 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:37.540265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29637c66-e24b-4b98-8d8d-d28d8e386db6 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:37.575758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2855c6-1387-4950-9610-ecc38c39ef4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:37.576429 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2855c6-1387-4950-9610-ecc38c39ef4c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:37.576785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2855c6-1387-4950-9610-ecc38c39ef4c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:37.577082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2855c6-1387-4950-9610-ecc38c39ef4c None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:37.578216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2855c6-1387-4950-9610-ecc38c39ef4c None admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:37.579669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2855c6-1387-4950-9610-ecc38c39ef4c None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:37.586543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 110/222] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:37 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:37.587941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8bac7-f196-4372-8345-7356f157a112 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:37.674134 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:37.694167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8bac7-f196-4372-8345-7356f157a112 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:37.730861 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cb089-17f4-4cfc-a89d-0c3cc62fcfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:37.731485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cb089-17f4-4cfc-a89d-0c3cc62fcfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:37.731767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cb089-17f4-4cfc-a89d-0c3cc62fcfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:37.732039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cb089-17f4-4cfc-a89d-0c3cc62fcfc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:37.732835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cb089-17f4-4cfc-a89d-0c3cc62fcfc5 None admin] RBAC: Adding query filter params (role.id=c1842e25399a42b980fe646bb06ac0d9, scope.project.id=e11856399ed04d35ad94267285ab565e, user.id=e282d48e0b1e4ef990e5cae26d6eea48) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:37.733143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cb089-17f4-4cfc-a89d-0c3cc62fcfc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:37.734607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cb089-17f4-4cfc-a89d-0c3cc62fcfc5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:37.748335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 113/223] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 12:59:37 2022] GET /identity/v3/role_assignments?user.id=e282d48e0b1e4ef990e5cae26d6eea48&scope.project.id=e11856399ed04d35ad94267285ab565e&role.id=c1842e25399a42b980fe646bb06ac0d9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:39.178528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c41d-b053-41de-b7ba-9f42d6c4b164 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.179085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c41d-b053-41de-b7ba-9f42d6c4b164 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.179085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c41d-b053-41de-b7ba-9f42d6c4b164 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.180421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 111/224] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:39.185861 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b1f2d-26c6-488d-a97b-1e6ec5e19936 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.186291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b1f2d-26c6-488d-a97b-1e6ec5e19936 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.186367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b1f2d-26c6-488d-a97b-1e6ec5e19936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.205137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-305b1f2d-26c6-488d-a97b-1e6ec5e19936 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:39.206315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-305b1f2d-26c6-488d-a97b-1e6ec5e19936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:39.235024 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffef0c-a7cb-4496-a5a2-1ce2ce1f882b None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.235293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffef0c-a7cb-4496-a5a2-1ce2ce1f882b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.235576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffef0c-a7cb-4496-a5a2-1ce2ce1f882b None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.237096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 112/225] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:39.241984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f237-e83f-4f1d-85ac-c529b6989f3a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.242265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f237-e83f-4f1d-85ac-c529b6989f3a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.242539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f237-e83f-4f1d-85ac-c529b6989f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.261938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-86f8f237-e83f-4f1d-85ac-c529b6989f3a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:39.263134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-86f8f237-e83f-4f1d-85ac-c529b6989f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:39.280043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 114/226] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:39.310022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:39.345622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 113/227] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:39.417156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f5f05-2566-4114-8b6a-112e73c1b06e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.417387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f5f05-2566-4114-8b6a-112e73c1b06e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.417700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f5f05-2566-4114-8b6a-112e73c1b06e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.419235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 115/228] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:39.424515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15cb5-f795-4960-bba8-98cd00ce9a96 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.424814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15cb5-f795-4960-bba8-98cd00ce9a96 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.425076 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15cb5-f795-4960-bba8-98cd00ce9a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.443889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ebd15cb5-f795-4960-bba8-98cd00ce9a96 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:39.445033 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ebd15cb5-f795-4960-bba8-98cd00ce9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:39.514420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 114/229] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:39.548823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f5f05-2566-4114-8b6a-112e73c1b06e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:39.606972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15cb5-f795-4960-bba8-98cd00ce9a96 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:39.633031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:39.657907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f5f05-2566-4114-8b6a-112e73c1b06e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:39.690609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58ef73-54f7-4812-ac4c-ddc8109c3b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:39.691243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58ef73-54f7-4812-ac4c-ddc8109c3b58 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.691529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58ef73-54f7-4812-ac4c-ddc8109c3b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.691787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58ef73-54f7-4812-ac4c-ddc8109c3b58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.701718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58ef73-54f7-4812-ac4c-ddc8109c3b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-1e58ef73-54f7-4812-ac4c-ddc8109c3b58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:39.706498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:39.707342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:39.708233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 116/230] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:39.713363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58ef73-54f7-4812-ac4c-ddc8109c3b58 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:39.714773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15cb5-f795-4960-bba8-98cd00ce9a96 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:39.716654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:39.754991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725982f-2999-4a18-8670-109e806805f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:39.755718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725982f-2999-4a18-8670-109e806805f8 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.756479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725982f-2999-4a18-8670-109e806805f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.756734 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725982f-2999-4a18-8670-109e806805f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.758272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725982f-2999-4a18-8670-109e806805f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:39.760186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725982f-2999-4a18-8670-109e806805f8 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:39.761987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 115/231] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:39.767332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725982f-2999-4a18-8670-109e806805f8 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:39.816990 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58ef73-54f7-4812-ac4c-ddc8109c3b58 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:39.853705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd5f68-176e-4956-980b-e6005c1e8b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:39.854337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd5f68-176e-4956-980b-e6005c1e8b7e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.854609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd5f68-176e-4956-980b-e6005c1e8b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.854884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd5f68-176e-4956-980b-e6005c1e8b7e None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.855561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd5f68-176e-4956-980b-e6005c1e8b7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:39.855864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd5f68-176e-4956-980b-e6005c1e8b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:39.857299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd5f68-176e-4956-980b-e6005c1e8b7e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:39.859443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:39.867056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 117/232] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:39.868445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd5f68-176e-4956-980b-e6005c1e8b7e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:39.874474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725982f-2999-4a18-8670-109e806805f8 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:39.908873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f92065-65bb-47e7-9c6d-335f801af1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:39.909486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f92065-65bb-47e7-9c6d-335f801af1d6 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:39.909759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f92065-65bb-47e7-9c6d-335f801af1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:39.910032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f92065-65bb-47e7-9c6d-335f801af1d6 None admin] PATH_INFO: `/v3/groups` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:39.910699 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f92065-65bb-47e7-9c6d-335f801af1d6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:39.912144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f92065-65bb-47e7-9c6d-335f801af1d6 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:39.928072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 116/233] 10.222.0.15 () {60 vars in 1134 bytes} [Mon Oct 24 12:59:39 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:39.933769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f92065-65bb-47e7-9c6d-335f801af1d6 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:39.969528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:39.973549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd5f68-176e-4956-980b-e6005c1e8b7e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:40.011878 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5537c95-a7aa-43af-a3a7-6e73c5c9ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:40.012569 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5537c95-a7aa-43af-a3a7-6e73c5c9ab5e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:40.012852 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5537c95-a7aa-43af-a3a7-6e73c5c9ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:40.013126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5537c95-a7aa-43af-a3a7-6e73c5c9ab5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:40.026707 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5537c95-a7aa-43af-a3a7-6e73c5c9ab5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b5537c95-a7aa-43af-a3a7-6e73c5c9ab5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:40.032325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:40.033448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:40.034274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 118/234] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:40.040705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5537c95-a7aa-43af-a3a7-6e73c5c9ab5e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:40.058694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f92065-65bb-47e7-9c6d-335f801af1d6 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:40.100791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063ecce-186f-4bfc-9d0d-c92f4f17e163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:40.101450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063ecce-186f-4bfc-9d0d-c92f4f17e163 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:40.101722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063ecce-186f-4bfc-9d0d-c92f4f17e163 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:40.101976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063ecce-186f-4bfc-9d0d-c92f4f17e163 None admin] PATH_INFO: `/v3/users/ee4a61156dc74e86a125b0933d4d6c5e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:40.105778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:40.116653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063ecce-186f-4bfc-9d0d-c92f4f17e163 None admin] RBAC: Authorizing `identity:get_user(user_id=ee4a61156dc74e86a125b0933d4d6c5e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:40.118435 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063ecce-186f-4bfc-9d0d-c92f4f17e163 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:40.119843 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 117/235] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:39 2022] GET /identity/v3/users/ee4a61156dc74e86a125b0933d4d6c5e => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:40.126159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063ecce-186f-4bfc-9d0d-c92f4f17e163 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:40.161610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5537c95-a7aa-43af-a3a7-6e73c5c9ab5e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:40.196392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257d6b-570c-4002-971e-b22eba6fa049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:40.197582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257d6b-570c-4002-971e-b22eba6fa049 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:40.197873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257d6b-570c-4002-971e-b22eba6fa049 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:40.198146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257d6b-570c-4002-971e-b22eba6fa049 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:40.199093 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f257d6b-570c-4002-971e-b22eba6fa049 None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:40.199398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f257d6b-570c-4002-971e-b22eba6fa049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:40.201958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f257d6b-570c-4002-971e-b22eba6fa049 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:40.216325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 119/236] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:40.217558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257d6b-570c-4002-971e-b22eba6fa049 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:40.223233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:40.238292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063ecce-186f-4bfc-9d0d-c92f4f17e163 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:40.277082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df3b7e-4ef7-4269-9cff-6ab7920489c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:40.277757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df3b7e-4ef7-4269-9cff-6ab7920489c4 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:40.277985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df3b7e-4ef7-4269-9cff-6ab7920489c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:40.278257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df3b7e-4ef7-4269-9cff-6ab7920489c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:40.278994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df3b7e-4ef7-4269-9cff-6ab7920489c4 None admin] RBAC: Adding query filter params (role.id=c1842e25399a42b980fe646bb06ac0d9, user.id=ee4a61156dc74e86a125b0933d4d6c5e, scope.system=all) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:40.279303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df3b7e-4ef7-4269-9cff-6ab7920489c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:40.280791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df3b7e-4ef7-4269-9cff-6ab7920489c4 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:40.286328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 118/237] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Oct 24 12:59:40 2022] GET /identity/v3/role_assignments?user.id=ee4a61156dc74e86a125b0933d4d6c5e&scope.system=all&role.id=c1842e25399a42b980fe646bb06ac0d9 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:40.336484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257d6b-570c-4002-971e-b22eba6fa049 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:40.361634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:40.379617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b37e1c-36ee-4fcd-9eb1-78b8f321d9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:40.380276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37e1c-36ee-4fcd-9eb1-78b8f321d9ef None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:40.380588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37e1c-36ee-4fcd-9eb1-78b8f321d9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:40.380861 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37e1c-36ee-4fcd-9eb1-78b8f321d9ef None admin] PATH_INFO: `/v3/users/dc3aec4430a8436dbf65e3045f2af4e4` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:40.382131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b37e1c-36ee-4fcd-9eb1-78b8f321d9ef None admin] RBAC: Authorizing `identity:get_user(user_id=dc3aec4430a8436dbf65e3045f2af4e4)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:40.383651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b37e1c-36ee-4fcd-9eb1-78b8f321d9ef None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:40.385633 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 120/238] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:40 2022] GET /identity/v3/users/dc3aec4430a8436dbf65e3045f2af4e4 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:40.391389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df3b7e-4ef7-4269-9cff-6ab7920489c4 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:40.502346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df3b7e-4ef7-4269-9cff-6ab7920489c4 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:40.537194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2616d29-deca-4e9d-9e01-337c80c0e57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:40.537853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616d29-deca-4e9d-9e01-337c80c0e57d None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:40.538134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616d29-deca-4e9d-9e01-337c80c0e57d None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:40.538394 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616d29-deca-4e9d-9e01-337c80c0e57d None admin] PATH_INFO: `/v3/system/users/dc3aec4430a8436dbf65e3045f2af4e4/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:40.539798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2616d29-deca-4e9d-9e01-337c80c0e57d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dc3aec4430a8436dbf65e3045f2af4e4, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:40.541244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2616d29-deca-4e9d-9e01-337c80c0e57d None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:40.551913 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 119/239] 10.222.0.15 () {58 vars in 1334 bytes} [Mon Oct 24 12:59:40 2022] PUT /identity/v3/system/users/dc3aec4430a8436dbf65e3045f2af4e4/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:42.086010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23e91-29ae-4f61-8efd-c229f5536460 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.086544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23e91-29ae-4f61-8efd-c229f5536460 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.086544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23e91-29ae-4f61-8efd-c229f5536460 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.088076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 121/240] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:42.093204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e883b4d-ff76-4797-ba46-1154adf36335 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.093609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e883b4d-ff76-4797-ba46-1154adf36335 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.093773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e883b4d-ff76-4797-ba46-1154adf36335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.112206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4e883b4d-ff76-4797-ba46-1154adf36335 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:42.113339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4e883b4d-ff76-4797-ba46-1154adf36335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:42.125164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:42.184179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 120/241] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:42.406095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153b7b1-f304-43d1-9f8c-d415727b3e8a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.406459 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153b7b1-f304-43d1-9f8c-d415727b3e8a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.406654 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153b7b1-f304-43d1-9f8c-d415727b3e8a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.408044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 122/242] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:42.413404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd089-82ff-431e-a25f-61b39e51c9c2 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.413694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd089-82ff-431e-a25f-61b39e51c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.413963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd089-82ff-431e-a25f-61b39e51c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.432240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-de9bd089-82ff-431e-a25f-61b39e51c9c2 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:42.433462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-de9bd089-82ff-431e-a25f-61b39e51c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:42.455947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153b7b1-f304-43d1-9f8c-d415727b3e8a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:42.509868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 121/243] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:42.561835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153b7b1-f304-43d1-9f8c-d415727b3e8a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:42.599196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d498b77-0af2-4b0e-8864-ba57b8b29fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:42.599836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d498b77-0af2-4b0e-8864-ba57b8b29fac None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.600111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d498b77-0af2-4b0e-8864-ba57b8b29fac None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.600401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d498b77-0af2-4b0e-8864-ba57b8b29fac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.601500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d498b77-0af2-4b0e-8864-ba57b8b29fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:42.602960 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d498b77-0af2-4b0e-8864-ba57b8b29fac None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:42.604732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 123/244] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:42.610161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bd089-82ff-431e-a25f-61b39e51c9c2 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:42.679487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574efc-3b3e-4f11-835c-94fade7e7542 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.679665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574efc-3b3e-4f11-835c-94fade7e7542 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.679915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574efc-3b3e-4f11-835c-94fade7e7542 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.681338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 124/245] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:42.686339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fff044-c07b-4d73-bd2a-4912214ea00c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.686628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fff044-c07b-4d73-bd2a-4912214ea00c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.686910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fff044-c07b-4d73-bd2a-4912214ea00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.688974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:42.705159 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e3fff044-c07b-4d73-bd2a-4912214ea00c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:42.706363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e3fff044-c07b-4d73-bd2a-4912214ea00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:42.714589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bd089-82ff-431e-a25f-61b39e51c9c2 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:42.749452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bab596-aaf4-435b-adfc-83f74f8b7321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:42.750058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bab596-aaf4-435b-adfc-83f74f8b7321 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.750334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bab596-aaf4-435b-adfc-83f74f8b7321 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.750604 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bab596-aaf4-435b-adfc-83f74f8b7321 None admin] PATH_INFO: `/v3/groups` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.751243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bab596-aaf4-435b-adfc-83f74f8b7321 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:42.752720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bab596-aaf4-435b-adfc-83f74f8b7321 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:42.756653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:42.771363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 122/246] 10.222.0.15 () {60 vars in 1134 bytes} [Mon Oct 24 12:59:42 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 12:59:42.779197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 125/247] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:42.780825 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bab596-aaf4-435b-adfc-83f74f8b7321 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:42.898198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bab596-aaf4-435b-adfc-83f74f8b7321 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:42.935197 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc739bb-63e9-4a85-8a45-9d3f98907b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:42.935767 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc739bb-63e9-4a85-8a45-9d3f98907b87 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:42.936151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc739bb-63e9-4a85-8a45-9d3f98907b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:42.936462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc739bb-63e9-4a85-8a45-9d3f98907b87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:42.939434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:42.950979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc739bb-63e9-4a85-8a45-9d3f98907b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-edc739bb-63e9-4a85-8a45-9d3f98907b87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:42.956515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:42.957568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:42.958496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 123/248] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:42.963652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fff044-c07b-4d73-bd2a-4912214ea00c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.046237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc739bb-63e9-4a85-8a45-9d3f98907b87 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.072992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fff044-c07b-4d73-bd2a-4912214ea00c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.111935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374a5b-ff11-42d8-a134-b35b75980f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.112597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374a5b-ff11-42d8-a134-b35b75980f70 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.112854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374a5b-ff11-42d8-a134-b35b75980f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.113130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374a5b-ff11-42d8-a134-b35b75980f70 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.113855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374a5b-ff11-42d8-a134-b35b75980f70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:43.114167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374a5b-ff11-42d8-a134-b35b75980f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.115620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374a5b-ff11-42d8-a134-b35b75980f70 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.126108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 126/249] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:43.131908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374a5b-ff11-42d8-a134-b35b75980f70 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.162893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc739bb-63e9-4a85-8a45-9d3f98907b87 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.187537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:43.213148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54e68-d137-46b3-9826-4290983bdd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.214202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54e68-d137-46b3-9826-4290983bdd8c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.214688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54e68-d137-46b3-9826-4290983bdd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.215180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54e68-d137-46b3-9826-4290983bdd8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.229915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde54e68-d137-46b3-9826-4290983bdd8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-dde54e68-d137-46b3-9826-4290983bdd8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:43.234872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:43.235751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:43.236591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 124/250] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:43.242706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54e68-d137-46b3-9826-4290983bdd8c None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.255244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374a5b-ff11-42d8-a134-b35b75980f70 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.305426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eb103-4f47-480d-92e6-8d3e687ae184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.306456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb103-4f47-480d-92e6-8d3e687ae184 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.307183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb103-4f47-480d-92e6-8d3e687ae184 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.308124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb103-4f47-480d-92e6-8d3e687ae184 None admin] PATH_INFO: `/v3/users/ee4a61156dc74e86a125b0933d4d6c5e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.309809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eb103-4f47-480d-92e6-8d3e687ae184 None admin] RBAC: Authorizing `identity:get_user(user_id=ee4a61156dc74e86a125b0933d4d6c5e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.312121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eb103-4f47-480d-92e6-8d3e687ae184 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.314904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 127/251] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:43 2022] GET /identity/v3/users/ee4a61156dc74e86a125b0933d4d6c5e => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:43.320392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eb103-4f47-480d-92e6-8d3e687ae184 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.321925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:43.384195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54e68-d137-46b3-9826-4290983bdd8c None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.436449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6be4a-f9f7-43f4-9901-dfe106275b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.437452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6be4a-f9f7-43f4-9901-dfe106275b4a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.438037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6be4a-f9f7-43f4-9901-dfe106275b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.438503 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6be4a-f9f7-43f4-9901-dfe106275b4a None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.439396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6be4a-f9f7-43f4-9901-dfe106275b4a None admin] RBAC: Adding query filter params (name=member) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:43.439901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6be4a-f9f7-43f4-9901-dfe106275b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.441547 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6be4a-f9f7-43f4-9901-dfe106275b4a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.452091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 125/252] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:43.460317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eb103-4f47-480d-92e6-8d3e687ae184 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.461584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6be4a-f9f7-43f4-9901-dfe106275b4a None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.470432 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:43.489981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3920627-8a35-475a-bfa7-b84244bd22c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.490617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3920627-8a35-475a-bfa7-b84244bd22c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.490938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3920627-8a35-475a-bfa7-b84244bd22c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.491208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3920627-8a35-475a-bfa7-b84244bd22c9 None admin] PATH_INFO: `/v3/system/users/ee4a61156dc74e86a125b0933d4d6c5e/roles/c1842e25399a42b980fe646bb06ac0d9` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.492738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3920627-8a35-475a-bfa7-b84244bd22c9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ee4a61156dc74e86a125b0933d4d6c5e, role_id=c1842e25399a42b980fe646bb06ac0d9)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.494299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3920627-8a35-475a-bfa7-b84244bd22c9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.506200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 128/253] 10.222.0.15 () {58 vars in 1334 bytes} [Mon Oct 24 12:59:43 2022] PUT /identity/v3/system/users/ee4a61156dc74e86a125b0933d4d6c5e/roles/c1842e25399a42b980fe646bb06ac0d9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 12:59:43.572749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6be4a-f9f7-43f4-9901-dfe106275b4a None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.592828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:43.611303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7d982-782a-4d00-ac9c-56a47c6eb069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.611960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d982-782a-4d00-ac9c-56a47c6eb069 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.612237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d982-782a-4d00-ac9c-56a47c6eb069 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.612541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d982-782a-4d00-ac9c-56a47c6eb069 None admin] PATH_INFO: `/v3/users/dc3aec4430a8436dbf65e3045f2af4e4` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.613813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7d982-782a-4d00-ac9c-56a47c6eb069 None admin] RBAC: Authorizing `identity:get_user(user_id=dc3aec4430a8436dbf65e3045f2af4e4)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.615287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7d982-782a-4d00-ac9c-56a47c6eb069 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.617016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 126/254] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:43 2022] GET /identity/v3/users/dc3aec4430a8436dbf65e3045f2af4e4 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:43.623424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3920627-8a35-475a-bfa7-b84244bd22c9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:43.751818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3920627-8a35-475a-bfa7-b84244bd22c9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:43.787695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508cf6e-5c59-42ce-8702-3653f0348569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:43.788362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508cf6e-5c59-42ce-8702-3653f0348569 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:43.788639 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508cf6e-5c59-42ce-8702-3653f0348569 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:43.788908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508cf6e-5c59-42ce-8702-3653f0348569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:43.789658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508cf6e-5c59-42ce-8702-3653f0348569 None admin] RBAC: Adding query filter params (role.id=5a473059a779480ca6031449b18aeb52, user.id=dc3aec4430a8436dbf65e3045f2af4e4, scope.system=all) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:43.790028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508cf6e-5c59-42ce-8702-3653f0348569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:43.791594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508cf6e-5c59-42ce-8702-3653f0348569 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:43.806383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 129/255] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Oct 24 12:59:43 2022] GET /identity/v3/role_assignments?user.id=dc3aec4430a8436dbf65e3045f2af4e4&scope.system=all&role.id=5a473059a779480ca6031449b18aeb52 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:45.189399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c01a-fde2-403e-a5de-45800d66ec46 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:45.190354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c01a-fde2-403e-a5de-45800d66ec46 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:45.190769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c01a-fde2-403e-a5de-45800d66ec46 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:45.192411 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 127/256] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:45.197648 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf3e16-0649-4379-a426-f545c1419237 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:45.198437 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf3e16-0649-4379-a426-f545c1419237 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:45.198902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf3e16-0649-4379-a426-f545c1419237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:45.229270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5dbf3e16-0649-4379-a426-f545c1419237 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:45.230812 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5dbf3e16-0649-4379-a426-f545c1419237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:45.279257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:45.303618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 130/257] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 12:59:45.565621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ecb8b-0a24-4905-ba8a-e3bc0552b341 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:45.565807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ecb8b-0a24-4905-ba8a-e3bc0552b341 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:45.566072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ecb8b-0a24-4905-ba8a-e3bc0552b341 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:45.567741 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 128/258] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:45.572955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef465dac-7388-4008-be96-584795ec966c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:45.573243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef465dac-7388-4008-be96-584795ec966c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:45.573576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef465dac-7388-4008-be96-584795ec966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:45.601313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ef465dac-7388-4008-be96-584795ec966c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:45.602546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ef465dac-7388-4008-be96-584795ec966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:45.610619 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 131/259] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 24 12:59:45.780784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ecb8b-0a24-4905-ba8a-e3bc0552b341 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:45.797827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ecb8b-0a24-4905-ba8a-e3bc0552b341 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:45.802208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794465a-b039-4b6e-a58a-cc4b11657743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:45.802855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794465a-b039-4b6e-a58a-cc4b11657743 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:45.803135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794465a-b039-4b6e-a58a-cc4b11657743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:45.803406 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794465a-b039-4b6e-a58a-cc4b11657743 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:45.814789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794465a-b039-4b6e-a58a-cc4b11657743 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-1794465a-b039-4b6e-a58a-cc4b11657743 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:45.819726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:45.820648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:45.821451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 129/260] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Oct 24 12:59:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:45.826576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef465dac-7388-4008-be96-584795ec966c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:45.840203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef465dac-7388-4008-be96-584795ec966c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:45.848590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82e73-0a6c-44ad-8d26-6c519df77056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:45.849442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82e73-0a6c-44ad-8d26-6c519df77056 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:45.849904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82e73-0a6c-44ad-8d26-6c519df77056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:45.850788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82e73-0a6c-44ad-8d26-6c519df77056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:45.851656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f82e73-0a6c-44ad-8d26-6c519df77056 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:45.852168 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f82e73-0a6c-44ad-8d26-6c519df77056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:45.854188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING py.warnings [None req-82f82e73-0a6c-44ad-8d26-6c519df77056 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 12:59:45.854188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: warnings.warn(msg) Oct 24 12:59:45.854188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: Oct 24 12:59:45.855482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f82e73-0a6c-44ad-8d26-6c519df77056 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:45.868265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 132/261] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 12:59:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:45.873941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794465a-b039-4b6e-a58a-cc4b11657743 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:45.884610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794465a-b039-4b6e-a58a-cc4b11657743 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:45.896352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2aa13-d8ad-4dda-b127-469604d22d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:45.897005 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2aa13-d8ad-4dda-b127-469604d22d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:45.897285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2aa13-d8ad-4dda-b127-469604d22d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:45.897561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2aa13-d8ad-4dda-b127-469604d22d5f admin admin] PATH_INFO: `/v3/groups/7c9b2884b50945789bb542094643e28d` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:45.904078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2aa13-d8ad-4dda-b127-469604d22d5f admin admin] RBAC: Authorizing `identity:get_group(group_id=7c9b2884b50945789bb542094643e28d)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:45.905907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WARNING py.warnings [None req-c3d2aa13-d8ad-4dda-b127-469604d22d5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 12:59:45.905907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: warnings.warn(msg) Oct 24 12:59:45.905907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: Oct 24 12:59:45.907147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2aa13-d8ad-4dda-b127-469604d22d5f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:45.909962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 130/262] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Oct 24 12:59:45 2022] GET /identity/v3/groups/7c9b2884b50945789bb542094643e28d => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:45.915843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82e73-0a6c-44ad-8d26-6c519df77056 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:45.929576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82e73-0a6c-44ad-8d26-6c519df77056 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:45.937734 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72d133-3a21-437d-b6b7-9e7ce52edda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:45.938535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72d133-3a21-437d-b6b7-9e7ce52edda6 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:45.938904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72d133-3a21-437d-b6b7-9e7ce52edda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:45.939267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72d133-3a21-437d-b6b7-9e7ce52edda6 admin admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:45.940542 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72d133-3a21-437d-b6b7-9e7ce52edda6 admin admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:45.943026 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72d133-3a21-437d-b6b7-9e7ce52edda6 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:45.945156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 133/263] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Oct 24 12:59:45 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:45.951855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2aa13-d8ad-4dda-b127-469604d22d5f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:45.966041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2aa13-d8ad-4dda-b127-469604d22d5f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:45.976427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7e9be-5eff-4fc7-bfff-4ce9a859d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:45.977293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e9be-5eff-4fc7-bfff-4ce9a859d402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:45.977711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e9be-5eff-4fc7-bfff-4ce9a859d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:45.978119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e9be-5eff-4fc7-bfff-4ce9a859d402 admin admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633/groups/7c9b2884b50945789bb542094643e28d/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:45.980142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7e9be-5eff-4fc7-bfff-4ce9a859d402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207f6da9736a443da019e48a2b2d7633, group_id=7c9b2884b50945789bb542094643e28d, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:45.981332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WARNING py.warnings [None req-f1c7e9be-5eff-4fc7-bfff-4ce9a859d402 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 12:59:45.981332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: warnings.warn(msg) Oct 24 12:59:45.981332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: Oct 24 12:59:45.983599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7e9be-5eff-4fc7-bfff-4ce9a859d402 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:46.021313 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 131/264] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Oct 24 12:59:45 2022] PUT /identity/v3/projects/207f6da9736a443da019e48a2b2d7633/groups/7c9b2884b50945789bb542094643e28d/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:46.179097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4362cd-4f62-4a69-a182-b169e79003c6 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.179545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4362cd-4f62-4a69-a182-b169e79003c6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.179941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4362cd-4f62-4a69-a182-b169e79003c6 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.181589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 134/265] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:46.181909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7e9be-5eff-4fc7-bfff-4ce9a859d402 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:46.187870 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c84e4c-e3a6-4a06-9c15-c113f7d54651 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.188180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c84e4c-e3a6-4a06-9c15-c113f7d54651 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.188450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c84e4c-e3a6-4a06-9c15-c113f7d54651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.218587 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b1c84e4c-e3a6-4a06-9c15-c113f7d54651 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:46.219822 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b1c84e4c-e3a6-4a06-9c15-c113f7d54651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:46.303236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7e9be-5eff-4fc7-bfff-4ce9a859d402 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:46.314540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f3c7b-fa77-4dbe-82e6-ac76372a9c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:46.316578 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f3c7b-fa77-4dbe-82e6-ac76372a9c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.316915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f3c7b-fa77-4dbe-82e6-ac76372a9c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.317185 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f3c7b-fa77-4dbe-82e6-ac76372a9c40 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.341539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f3c7b-fa77-4dbe-82e6-ac76372a9c40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-b08f3c7b-fa77-4dbe-82e6-ac76372a9c40 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:46.347766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:46.348736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:46.349538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 132/266] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Oct 24 12:59:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:46.357544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f3c7b-fa77-4dbe-82e6-ac76372a9c40 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:46.366572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 135/267] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:46.370119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f3c7b-fa77-4dbe-82e6-ac76372a9c40 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:46.380745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5aa9d8-e409-4a7d-a49a-1509bf88a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:46.381424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aa9d8-e409-4a7d-a49a-1509bf88a67f admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.381703 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aa9d8-e409-4a7d-a49a-1509bf88a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.381974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aa9d8-e409-4a7d-a49a-1509bf88a67f admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.382711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5aa9d8-e409-4a7d-a49a-1509bf88a67f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:46.383012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5aa9d8-e409-4a7d-a49a-1509bf88a67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:46.384085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WARNING py.warnings [None req-7b5aa9d8-e409-4a7d-a49a-1509bf88a67f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 12:59:46.384085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: warnings.warn(msg) Oct 24 12:59:46.384085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: Oct 24 12:59:46.385085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5aa9d8-e409-4a7d-a49a-1509bf88a67f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:46.394580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 133/268] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Oct 24 12:59:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:46.401339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c84e4c-e3a6-4a06-9c15-c113f7d54651 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:46.415131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c84e4c-e3a6-4a06-9c15-c113f7d54651 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:46.423244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414a014-7feb-4e60-9e9e-d430fb3de79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:46.424275 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414a014-7feb-4e60-9e9e-d430fb3de79e admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.424776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414a014-7feb-4e60-9e9e-d430fb3de79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.425241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414a014-7feb-4e60-9e9e-d430fb3de79e admin admin] PATH_INFO: `/v3/groups/7c9b2884b50945789bb542094643e28d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.429220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414a014-7feb-4e60-9e9e-d430fb3de79e admin admin] RBAC: Authorizing `identity:get_group(group_id=7c9b2884b50945789bb542094643e28d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:46.430564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING py.warnings [None req-f414a014-7feb-4e60-9e9e-d430fb3de79e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 12:59:46.430564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: warnings.warn(msg) Oct 24 12:59:46.430564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: Oct 24 12:59:46.432157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414a014-7feb-4e60-9e9e-d430fb3de79e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:46.434483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 136/269] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Oct 24 12:59:46 2022] GET /identity/v3/groups/7c9b2884b50945789bb542094643e28d => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:46.440587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5aa9d8-e409-4a7d-a49a-1509bf88a67f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:46.452125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5aa9d8-e409-4a7d-a49a-1509bf88a67f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:46.463376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a5bf8-c41d-4897-864c-85006f583d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:46.464072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a5bf8-c41d-4897-864c-85006f583d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.464368 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a5bf8-c41d-4897-864c-85006f583d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.464686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a5bf8-c41d-4897-864c-85006f583d65 admin admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.466512 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a5bf8-c41d-4897-864c-85006f583d65 admin admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:46.468702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a5bf8-c41d-4897-864c-85006f583d65 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:46.470451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 134/270] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Oct 24 12:59:46 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:46.476430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414a014-7feb-4e60-9e9e-d430fb3de79e admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:46.494763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414a014-7feb-4e60-9e9e-d430fb3de79e admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:46.503201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57479d-1865-4e59-9505-4473d88fdb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:46.504151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57479d-1865-4e59-9505-4473d88fdb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.504679 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57479d-1865-4e59-9505-4473d88fdb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.505164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57479d-1865-4e59-9505-4473d88fdb0e admin admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633/groups/7c9b2884b50945789bb542094643e28d/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.510020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57479d-1865-4e59-9505-4473d88fdb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=207f6da9736a443da019e48a2b2d7633, group_id=7c9b2884b50945789bb542094643e28d, role_id=e1bfcdd2169d4f49bb8a72e8dd7c33cf)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:46.511253 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING py.warnings [None req-5d57479d-1865-4e59-9505-4473d88fdb0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 12:59:46.511253 dv-cinder-862489-1-smb devstack@keystone.service[81637]: warnings.warn(msg) Oct 24 12:59:46.511253 dv-cinder-862489-1-smb devstack@keystone.service[81637]: Oct 24 12:59:46.513622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57479d-1865-4e59-9505-4473d88fdb0e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:46.539727 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 137/271] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Oct 24 12:59:46 2022] PUT /identity/v3/projects/207f6da9736a443da019e48a2b2d7633/groups/7c9b2884b50945789bb542094643e28d/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:46.793807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3c6b1-a178-443b-8447-2db7df3eac6b None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.793996 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3c6b1-a178-443b-8447-2db7df3eac6b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.794257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3c6b1-a178-443b-8447-2db7df3eac6b None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.795893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 135/272] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:46.801537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fd3cb-94dc-4d03-aee5-4b1c3c941fea None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:46.801872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fd3cb-94dc-4d03-aee5-4b1c3c941fea None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:46.802156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fd3cb-94dc-4d03-aee5-4b1c3c941fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:46.828678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7f0fd3cb-94dc-4d03-aee5-4b1c3c941fea None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:46.829881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7f0fd3cb-94dc-4d03-aee5-4b1c3c941fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:46.915442 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3c6b1-a178-443b-8447-2db7df3eac6b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:46.916838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 138/273] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 12:59:47.017246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:47.042440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3c6b1-a178-443b-8447-2db7df3eac6b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.081107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e5711-7b4f-468d-b586-4e34b66749f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.081674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e5711-7b4f-468d-b586-4e34b66749f9 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.081952 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e5711-7b4f-468d-b586-4e34b66749f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.082226 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e5711-7b4f-468d-b586-4e34b66749f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.093577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e5711-7b4f-468d-b586-4e34b66749f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-e85e5711-7b4f-468d-b586-4e34b66749f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:47.098381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:47.099260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:47.100511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 136/274] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:47.105716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fd3cb-94dc-4d03-aee5-4b1c3c941fea None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.147971 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:47.250729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fd3cb-94dc-4d03-aee5-4b1c3c941fea None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.301029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545024cc-3166-42a9-b7f5-31f2377ab7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.301743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545024cc-3166-42a9-b7f5-31f2377ab7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.302025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545024cc-3166-42a9-b7f5-31f2377ab7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.302302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545024cc-3166-42a9-b7f5-31f2377ab7d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.302999 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545024cc-3166-42a9-b7f5-31f2377ab7d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:47.303290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545024cc-3166-42a9-b7f5-31f2377ab7d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.304804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545024cc-3166-42a9-b7f5-31f2377ab7d7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.314397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 139/275] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:47.320323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e5711-7b4f-468d-b586-4e34b66749f9 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.443913 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e5711-7b4f-468d-b586-4e34b66749f9 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.457271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545024cc-3166-42a9-b7f5-31f2377ab7d7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.468836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545024cc-3166-42a9-b7f5-31f2377ab7d7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.477731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400065e-8b0a-49ba-b5a7-c306733d93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.478385 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400065e-8b0a-49ba-b5a7-c306733d93cc admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.478661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400065e-8b0a-49ba-b5a7-c306733d93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.478939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400065e-8b0a-49ba-b5a7-c306733d93cc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.500608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400065e-8b0a-49ba-b5a7-c306733d93cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:47.512949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592b924-a5d1-43a8-9e7b-47a44d5842eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.513606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592b924-a5d1-43a8-9e7b-47a44d5842eb None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.513885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592b924-a5d1-43a8-9e7b-47a44d5842eb None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.514160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592b924-a5d1-43a8-9e7b-47a44d5842eb None admin] PATH_INFO: `/v3/users/ee4a61156dc74e86a125b0933d4d6c5e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.515295 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592b924-a5d1-43a8-9e7b-47a44d5842eb None admin] RBAC: Authorizing `identity:get_user(user_id=ee4a61156dc74e86a125b0933d4d6c5e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-d400065e-8b0a-49ba-b5a7-c306733d93cc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:47.515659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:47.517787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:47.519772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:47.521385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592b924-a5d1-43a8-9e7b-47a44d5842eb None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.521523 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 140/276] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 12:59:47.521658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 137/277] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/users/ee4a61156dc74e86a125b0933d4d6c5e => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:47.521800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c9332-b39e-42a8-8884-7892cfde8a94 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.521800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c9332-b39e-42a8-8884-7892cfde8a94 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.521800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c9332-b39e-42a8-8884-7892cfde8a94 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.523343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 141/278] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:47.528107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592b924-a5d1-43a8-9e7b-47a44d5842eb None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.528645 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c9332-b39e-42a8-8884-7892cfde8a94 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.544814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c9332-b39e-42a8-8884-7892cfde8a94 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.549199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09921e5c-a589-45b9-9825-d0015f9c228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.549813 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09921e5c-a589-45b9-9825-d0015f9c228d admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.550089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09921e5c-a589-45b9-9825-d0015f9c228d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.550362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09921e5c-a589-45b9-9825-d0015f9c228d admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.550524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:47.551033 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09921e5c-a589-45b9-9825-d0015f9c228d admin admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:47.551387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09921e5c-a589-45b9-9825-d0015f9c228d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.553075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09921e5c-a589-45b9-9825-d0015f9c228d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.564833 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 142/279] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:47.566042 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f90d-9acd-4f6c-9dce-cc8114800955 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.566424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f90d-9acd-4f6c-9dce-cc8114800955 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.566704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f90d-9acd-4f6c-9dce-cc8114800955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.603725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7146f90d-9acd-4f6c-9dce-cc8114800955 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:47.605010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7146f90d-9acd-4f6c-9dce-cc8114800955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:47.628166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 143/280] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 12:59:47.628995 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f90d-9acd-4f6c-9dce-cc8114800955 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.650600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f90d-9acd-4f6c-9dce-cc8114800955 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.664749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca91650-65b2-47e1-9ebc-52d0201ed5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.665407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91650-65b2-47e1-9ebc-52d0201ed5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.665684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91650-65b2-47e1-9ebc-52d0201ed5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.665956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91650-65b2-47e1-9ebc-52d0201ed5a1 admin admin] PATH_INFO: `/v3/groups/7c9b2884b50945789bb542094643e28d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.667650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca91650-65b2-47e1-9ebc-52d0201ed5a1 admin admin] RBAC: Authorizing `identity:get_group(group_id=7c9b2884b50945789bb542094643e28d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.669614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca91650-65b2-47e1-9ebc-52d0201ed5a1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.671210 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 144/281] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/groups/7c9b2884b50945789bb542094643e28d => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:47.682765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca91650-65b2-47e1-9ebc-52d0201ed5a1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.705431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca91650-65b2-47e1-9ebc-52d0201ed5a1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.714044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc197b79-0864-4c28-b56b-4dbc9cc08cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.714692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc197b79-0864-4c28-b56b-4dbc9cc08cee admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.714969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc197b79-0864-4c28-b56b-4dbc9cc08cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.715240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc197b79-0864-4c28-b56b-4dbc9cc08cee admin admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.721262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc197b79-0864-4c28-b56b-4dbc9cc08cee admin admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.723488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc197b79-0864-4c28-b56b-4dbc9cc08cee admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.727932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 145/282] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:47.734707 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc197b79-0864-4c28-b56b-4dbc9cc08cee admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:47.756915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc197b79-0864-4c28-b56b-4dbc9cc08cee admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.762328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592b924-a5d1-43a8-9e7b-47a44d5842eb None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:47.776253 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218d51-c718-42eb-8d12-bf6c7936916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.777020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218d51-c718-42eb-8d12-bf6c7936916d admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.777301 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218d51-c718-42eb-8d12-bf6c7936916d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.777572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218d51-c718-42eb-8d12-bf6c7936916d admin admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e/groups/7c9b2884b50945789bb542094643e28d/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.780252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218d51-c718-42eb-8d12-bf6c7936916d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11856399ed04d35ad94267285ab565e, group_id=7c9b2884b50945789bb542094643e28d, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.782955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218d51-c718-42eb-8d12-bf6c7936916d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.819064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 146/283] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Oct 24 12:59:47 2022] PUT /identity/v3/projects/e11856399ed04d35ad94267285ab565e/groups/7c9b2884b50945789bb542094643e28d/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:47.830168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee276237-921c-4bc0-bb89-e888babc7181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:47.830907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee276237-921c-4bc0-bb89-e888babc7181 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:47.831169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee276237-921c-4bc0-bb89-e888babc7181 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:47.831440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee276237-921c-4bc0-bb89-e888babc7181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:47.832184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee276237-921c-4bc0-bb89-e888babc7181 None admin] RBAC: Adding query filter params (role.id=c1842e25399a42b980fe646bb06ac0d9, user.id=ee4a61156dc74e86a125b0933d4d6c5e, scope.system=all) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:47.832662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee276237-921c-4bc0-bb89-e888babc7181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:47.834139 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee276237-921c-4bc0-bb89-e888babc7181 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:47.860688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 138/284] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Oct 24 12:59:47 2022] GET /identity/v3/role_assignments?user.id=ee4a61156dc74e86a125b0933d4d6c5e&scope.system=all&role.id=c1842e25399a42b980fe646bb06ac0d9 => generated 510 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:48.100700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218d51-c718-42eb-8d12-bf6c7936916d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:48.155438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:48.173905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218d51-c718-42eb-8d12-bf6c7936916d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:48.184633 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb556fb2-28aa-4efb-9352-75a450ae15cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:48.185298 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb556fb2-28aa-4efb-9352-75a450ae15cd admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.185573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb556fb2-28aa-4efb-9352-75a450ae15cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.185845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb556fb2-28aa-4efb-9352-75a450ae15cd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.201546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb556fb2-28aa-4efb-9352-75a450ae15cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-bb556fb2-28aa-4efb-9352-75a450ae15cd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:48.208107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:48.209070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:48.210343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 147/285] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Oct 24 12:59:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:48.215422 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee276237-921c-4bc0-bb89-e888babc7181 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:48.229922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee276237-921c-4bc0-bb89-e888babc7181 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:48.235886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd638-7a2c-4d05-b7af-ee6f24fcbfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:48.236544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd638-7a2c-4d05-b7af-ee6f24fcbfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.236824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd638-7a2c-4d05-b7af-ee6f24fcbfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.237092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd638-7a2c-4d05-b7af-ee6f24fcbfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.237791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cd638-7a2c-4d05-b7af-ee6f24fcbfd2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:48.238087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cd638-7a2c-4d05-b7af-ee6f24fcbfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:48.239795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cd638-7a2c-4d05-b7af-ee6f24fcbfd2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:48.253222 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 139/286] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Oct 24 12:59:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:48.259064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb556fb2-28aa-4efb-9352-75a450ae15cd admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:48.271849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb556fb2-28aa-4efb-9352-75a450ae15cd admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:48.283160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d8bae-a999-4d51-bbb1-b909ca3cae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:48.283846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d8bae-a999-4d51-bbb1-b909ca3cae8b admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.284125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d8bae-a999-4d51-bbb1-b909ca3cae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.284428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d8bae-a999-4d51-bbb1-b909ca3cae8b admin admin] PATH_INFO: `/v3/groups/7c9b2884b50945789bb542094643e28d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.285748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d8bae-a999-4d51-bbb1-b909ca3cae8b admin admin] RBAC: Authorizing `identity:get_group(group_id=7c9b2884b50945789bb542094643e28d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:48.287765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d8bae-a999-4d51-bbb1-b909ca3cae8b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:48.289886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 148/287] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Oct 24 12:59:48 2022] GET /identity/v3/groups/7c9b2884b50945789bb542094643e28d => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:48.295724 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd638-7a2c-4d05-b7af-ee6f24fcbfd2 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:48.307127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd638-7a2c-4d05-b7af-ee6f24fcbfd2 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:48.318163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b55b9a-a000-4a25-bf00-de1efc776e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:48.318847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b55b9a-a000-4a25-bf00-de1efc776e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.319126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b55b9a-a000-4a25-bf00-de1efc776e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.319400 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b55b9a-a000-4a25-bf00-de1efc776e0a admin admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.320605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b55b9a-a000-4a25-bf00-de1efc776e0a admin admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:48.322742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b55b9a-a000-4a25-bf00-de1efc776e0a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:48.324502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 140/288] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Oct 24 12:59:48 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:48.330539 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d8bae-a999-4d51-bbb1-b909ca3cae8b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:48.345735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d8bae-a999-4d51-bbb1-b909ca3cae8b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:48.350429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2a7b3-e5a2-48dc-ab77-7594749e7146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:48.351162 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2a7b3-e5a2-48dc-ab77-7594749e7146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.351405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2a7b3-e5a2-48dc-ab77-7594749e7146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.351637 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2a7b3-e5a2-48dc-ab77-7594749e7146 admin admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e/groups/7c9b2884b50945789bb542094643e28d/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.358125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2a7b3-e5a2-48dc-ab77-7594749e7146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11856399ed04d35ad94267285ab565e, group_id=7c9b2884b50945789bb542094643e28d, role_id=e1bfcdd2169d4f49bb8a72e8dd7c33cf)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:48.360850 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2a7b3-e5a2-48dc-ab77-7594749e7146 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:48.393405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 149/289] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Oct 24 12:59:48 2022] PUT /identity/v3/projects/e11856399ed04d35ad94267285ab565e/groups/7c9b2884b50945789bb542094643e28d/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:48.446146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c915e29-c78c-4391-83fc-dbdecbe1f0e6 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.446476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c915e29-c78c-4391-83fc-dbdecbe1f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.446698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c915e29-c78c-4391-83fc-dbdecbe1f0e6 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.448430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 141/290] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:48.455679 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a623-31ac-40a5-b9e4-00f589a7080f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:48.455964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a623-31ac-40a5-b9e4-00f589a7080f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:48.456241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a623-31ac-40a5-b9e4-00f589a7080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:48.481390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-acb1a623-31ac-40a5-b9e4-00f589a7080f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:48.482678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-acb1a623-31ac-40a5-b9e4-00f589a7080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:48.561027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 150/291] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 12:59:49.019879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c915e29-c78c-4391-83fc-dbdecbe1f0e6 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:49.037112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c915e29-c78c-4391-83fc-dbdecbe1f0e6 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:49.041519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af66e-a0a2-4ed6-a0f3-81677d64c4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:49.042166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af66e-a0a2-4ed6-a0f3-81677d64c4de admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:49.042439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af66e-a0a2-4ed6-a0f3-81677d64c4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:49.042706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af66e-a0a2-4ed6-a0f3-81677d64c4de admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:49.060690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af66e-a0a2-4ed6-a0f3-81677d64c4de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-b56af66e-a0a2-4ed6-a0f3-81677d64c4de admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:49.065802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:49.066817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:49.068074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 142/292] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Oct 24 12:59:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:49.074974 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1a623-31ac-40a5-b9e4-00f589a7080f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:49.089477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1a623-31ac-40a5-b9e4-00f589a7080f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:49.097912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dde1e-5678-4526-bcac-b7af078d30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:49.098624 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dde1e-5678-4526-bcac-b7af078d30f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:49.098905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dde1e-5678-4526-bcac-b7af078d30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:49.099178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dde1e-5678-4526-bcac-b7af078d30f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:49.099864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dde1e-5678-4526-bcac-b7af078d30f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:49.100164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dde1e-5678-4526-bcac-b7af078d30f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:49.101825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dde1e-5678-4526-bcac-b7af078d30f7 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:49.116033 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 151/293] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Oct 24 12:59:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:49.122155 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af66e-a0a2-4ed6-a0f3-81677d64c4de admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:49.135903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af66e-a0a2-4ed6-a0f3-81677d64c4de admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:49.140375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103722e7-cadc-4d77-9ca8-3058d23b106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:49.141013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103722e7-cadc-4d77-9ca8-3058d23b106a admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:49.141290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103722e7-cadc-4d77-9ca8-3058d23b106a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:49.141565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103722e7-cadc-4d77-9ca8-3058d23b106a admin admin] PATH_INFO: `/v3/groups/36f873898bbd46d8872e86caf95c84f8` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:49.149318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103722e7-cadc-4d77-9ca8-3058d23b106a admin admin] RBAC: Authorizing `identity:get_group(group_id=36f873898bbd46d8872e86caf95c84f8)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:49.151257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103722e7-cadc-4d77-9ca8-3058d23b106a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:49.152923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 143/294] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Oct 24 12:59:49 2022] GET /identity/v3/groups/36f873898bbd46d8872e86caf95c84f8 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:49.158806 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dde1e-5678-4526-bcac-b7af078d30f7 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:49.173444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dde1e-5678-4526-bcac-b7af078d30f7 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:49.178023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8832ef7-6231-489c-8ec3-4ff2d31d92f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:49.178660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8832ef7-6231-489c-8ec3-4ff2d31d92f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:49.178936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8832ef7-6231-489c-8ec3-4ff2d31d92f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:49.179202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8832ef7-6231-489c-8ec3-4ff2d31d92f9 admin admin] PATH_INFO: `/v3/projects/137e4bed4da241048e2ccc51fb5ebefa` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:49.184992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8832ef7-6231-489c-8ec3-4ff2d31d92f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=137e4bed4da241048e2ccc51fb5ebefa)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:49.186804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8832ef7-6231-489c-8ec3-4ff2d31d92f9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:49.188569 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 152/295] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Oct 24 12:59:49 2022] GET /identity/v3/projects/137e4bed4da241048e2ccc51fb5ebefa => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:49.194680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103722e7-cadc-4d77-9ca8-3058d23b106a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:49.209655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103722e7-cadc-4d77-9ca8-3058d23b106a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:49.217816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333600eb-1c3e-420e-9b3a-866268c70e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:49.218507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333600eb-1c3e-420e-9b3a-866268c70e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:49.218788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333600eb-1c3e-420e-9b3a-866268c70e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:49.219089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333600eb-1c3e-420e-9b3a-866268c70e11 admin admin] PATH_INFO: `/v3/projects/137e4bed4da241048e2ccc51fb5ebefa/groups/36f873898bbd46d8872e86caf95c84f8/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:49.221010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333600eb-1c3e-420e-9b3a-866268c70e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137e4bed4da241048e2ccc51fb5ebefa, group_id=36f873898bbd46d8872e86caf95c84f8, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:49.223809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333600eb-1c3e-420e-9b3a-866268c70e11 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:49.246769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 144/296] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Oct 24 12:59:49 2022] PUT /identity/v3/projects/137e4bed4da241048e2ccc51fb5ebefa/groups/36f873898bbd46d8872e86caf95c84f8/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 12:59:49.474708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfcf58-6336-477a-bb9d-7847ab7b4222 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:49.475241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfcf58-6336-477a-bb9d-7847ab7b4222 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:49.475241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfcf58-6336-477a-bb9d-7847ab7b4222 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:49.476942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 153/297] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:49.485195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07194d7-9634-4892-91f8-470698c928a5 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:49.485711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07194d7-9634-4892-91f8-470698c928a5 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:49.485783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07194d7-9634-4892-91f8-470698c928a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:49.512782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d07194d7-9634-4892-91f8-470698c928a5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:49.514036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d07194d7-9634-4892-91f8-470698c928a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:49.537542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:49.606613 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 145/298] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:49.855360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701386c-e5f6-4e47-bd64-11d475f0160d None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:49.855360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701386c-e5f6-4e47-bd64-11d475f0160d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:49.855360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701386c-e5f6-4e47-bd64-11d475f0160d None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:49.855998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 154/299] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:49.861025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fb066-e32a-43df-bf71-25cb6329c430 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:49.861311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fb066-e32a-43df-bf71-25cb6329c430 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:49.861586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fb066-e32a-43df-bf71-25cb6329c430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:49.886171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-2e2fb066-e32a-43df-bf71-25cb6329c430 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:49.887368 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2e2fb066-e32a-43df-bf71-25cb6329c430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:49.923547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701386c-e5f6-4e47-bd64-11d475f0160d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:49.978449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 146/300] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:50.074123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:50.082081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701386c-e5f6-4e47-bd64-11d475f0160d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:50.126665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c4c10-0664-43ba-819f-b37e3e787e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:50.127230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c4c10-0664-43ba-819f-b37e3e787e42 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:50.127508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c4c10-0664-43ba-819f-b37e3e787e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:50.127778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c4c10-0664-43ba-819f-b37e3e787e42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:50.144696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c4c10-0664-43ba-819f-b37e3e787e42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-fc9c4c10-0664-43ba-819f-b37e3e787e42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:50.149720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:50.150606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:50.151825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 155/301] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 12:59:50.156941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fb066-e32a-43df-bf71-25cb6329c430 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:50.250929 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:50.272381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fb066-e32a-43df-bf71-25cb6329c430 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:50.315346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cceec0-a23c-40bc-bb9f-fdfe799d89f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:50.315966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cceec0-a23c-40bc-bb9f-fdfe799d89f5 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:50.316241 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cceec0-a23c-40bc-bb9f-fdfe799d89f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:50.316536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cceec0-a23c-40bc-bb9f-fdfe799d89f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:50.317245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cceec0-a23c-40bc-bb9f-fdfe799d89f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:50.317546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cceec0-a23c-40bc-bb9f-fdfe799d89f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:50.318923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cceec0-a23c-40bc-bb9f-fdfe799d89f5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:50.321995 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c4c10-0664-43ba-819f-b37e3e787e42 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:50.330416 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 147/302] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:50.341048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cceec0-a23c-40bc-bb9f-fdfe799d89f5 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:50.450482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cceec0-a23c-40bc-bb9f-fdfe799d89f5 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:50.489460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e493a3-7f5a-4031-a8cc-c1348b236b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:50.491043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e493a3-7f5a-4031-a8cc-c1348b236b31 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:50.491524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e493a3-7f5a-4031-a8cc-c1348b236b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:50.492031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e493a3-7f5a-4031-a8cc-c1348b236b31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:50.521252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:50.549731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c4c10-0664-43ba-819f-b37e3e787e42 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:50.622730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f882e-3a21-4aaf-9a3d-58724f8886d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:50.625901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f882e-3a21-4aaf-9a3d-58724f8886d3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:50.626177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f882e-3a21-4aaf-9a3d-58724f8886d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:50.626448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f882e-3a21-4aaf-9a3d-58724f8886d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:50.633330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e493a3-7f5a-4031-a8cc-c1348b236b31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:50.634813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e493a3-7f5a-4031-a8cc-c1348b236b31 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:50.653747 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f882e-3a21-4aaf-9a3d-58724f8886d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b88f882e-3a21-4aaf-9a3d-58724f8886d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:50.659194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:50.660100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:50.661057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:50.664880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 156/303] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 12:59:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:50.673482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f882e-3a21-4aaf-9a3d-58724f8886d3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:50.712153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:50.774055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 148/304] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 12:59:50.779928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e493a3-7f5a-4031-a8cc-c1348b236b31 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:50.885447 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f882e-3a21-4aaf-9a3d-58724f8886d3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:50.888879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:50.946480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec97a7a-c256-4dc3-b3ed-b60799d962cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:50.947272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97a7a-c256-4dc3-b3ed-b60799d962cc None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:50.947555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97a7a-c256-4dc3-b3ed-b60799d962cc None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:50.947828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97a7a-c256-4dc3-b3ed-b60799d962cc None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:50.948604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec97a7a-c256-4dc3-b3ed-b60799d962cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:50.949323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec97a7a-c256-4dc3-b3ed-b60799d962cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:50.950725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec97a7a-c256-4dc3-b3ed-b60799d962cc None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:50.961772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 157/305] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 12:59:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:50.968098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5d5d-6baa-4ea3-93f0-f9306fa61357 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:50.968431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5d5d-6baa-4ea3-93f0-f9306fa61357 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:50.968715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5d5d-6baa-4ea3-93f0-f9306fa61357 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:50.970391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 158/306] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:50.971215 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea5d5d-6baa-4ea3-93f0-f9306fa61357 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:50.973563 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e493a3-7f5a-4031-a8cc-c1348b236b31 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:51.014867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd4ebd-93d4-467a-84c8-0fec6d070465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:51.016709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd4ebd-93d4-467a-84c8-0fec6d070465 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.016991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd4ebd-93d4-467a-84c8-0fec6d070465 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.017255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd4ebd-93d4-467a-84c8-0fec6d070465 None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.021247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd4ebd-93d4-467a-84c8-0fec6d070465 None admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:51.022723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd4ebd-93d4-467a-84c8-0fec6d070465 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:51.024745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 149/307] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:50 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:51.025934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2c8a8-b98e-461e-b201-dd98df48be3e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.026211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2c8a8-b98e-461e-b201-dd98df48be3e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.026482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2c8a8-b98e-461e-b201-dd98df48be3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.047169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-abf2c8a8-b98e-461e-b201-dd98df48be3e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:51.048728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-abf2c8a8-b98e-461e-b201-dd98df48be3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:51.076536 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:51.110491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea5d5d-6baa-4ea3-93f0-f9306fa61357 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:51.136479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 150/308] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:51.137393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2c8a8-b98e-461e-b201-dd98df48be3e None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:51.163774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f9b3-89a6-4831-98ad-93cb97ba2f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:51.165072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f9b3-89a6-4831-98ad-93cb97ba2f24 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.165493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f9b3-89a6-4831-98ad-93cb97ba2f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.166025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f9b3-89a6-4831-98ad-93cb97ba2f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.241081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:51.247401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f9b3-89a6-4831-98ad-93cb97ba2f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:51.251057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f9b3-89a6-4831-98ad-93cb97ba2f24 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:51.312914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2c8a8-b98e-461e-b201-dd98df48be3e None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:51.337615 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:51.353333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f182c6-7105-4210-a97b-c8d445c6cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:51.353977 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f182c6-7105-4210-a97b-c8d445c6cec7 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.354313 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f182c6-7105-4210-a97b-c8d445c6cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.354583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f182c6-7105-4210-a97b-c8d445c6cec7 None admin] PATH_INFO: `/v3/groups/7c9b2884b50945789bb542094643e28d` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.355714 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f182c6-7105-4210-a97b-c8d445c6cec7 None admin] RBAC: Authorizing `identity:get_group(group_id=7c9b2884b50945789bb542094643e28d)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:51.357220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f182c6-7105-4210-a97b-c8d445c6cec7 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:51.359104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 151/309] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Oct 24 12:59:51 2022] GET /identity/v3/groups/7c9b2884b50945789bb542094643e28d => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:51.360238 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd9ec2-354c-4c56-8846-06065269c82f None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.364672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd9ec2-354c-4c56-8846-06065269c82f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.364962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd9ec2-354c-4c56-8846-06065269c82f None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.366504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 152/310] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:51.367059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 159/311] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 12:59:51.372442 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd9ec2-354c-4c56-8846-06065269c82f None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:51.374107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f25225-a716-4884-bc33-a8739a07d61f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.374389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f25225-a716-4884-bc33-a8739a07d61f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.374660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f25225-a716-4884-bc33-a8739a07d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.393997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-10f25225-a716-4884-bc33-a8739a07d61f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:51.395516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-10f25225-a716-4884-bc33-a8739a07d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:51.506067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 160/312] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:51.507641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f25225-a716-4884-bc33-a8739a07d61f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:51.512874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd9ec2-354c-4c56-8846-06065269c82f None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:51.521494 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:51.549954 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48d9ce-8a30-4a6c-b32d-d5225ffac0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:51.551339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48d9ce-8a30-4a6c-b32d-d5225ffac0ff None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.551339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48d9ce-8a30-4a6c-b32d-d5225ffac0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.551339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48d9ce-8a30-4a6c-b32d-d5225ffac0ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.554705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48d9ce-8a30-4a6c-b32d-d5225ffac0ff None admin] RBAC: Adding query filter params (group.id=7c9b2884b50945789bb542094643e28d, role.id=5a473059a779480ca6031449b18aeb52, scope.project.id=207f6da9736a443da019e48a2b2d7633) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:51.554705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48d9ce-8a30-4a6c-b32d-d5225ffac0ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:51.554705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48d9ce-8a30-4a6c-b32d-d5225ffac0ff None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:51.562728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 153/313] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Oct 24 12:59:51 2022] GET /identity/v3/role_assignments?group.id=7c9b2884b50945789bb542094643e28d&scope.project.id=207f6da9736a443da019e48a2b2d7633&role.id=5a473059a779480ca6031449b18aeb52 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:51.568605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48d9ce-8a30-4a6c-b32d-d5225ffac0ff None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:51.640906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f25225-a716-4884-bc33-a8739a07d61f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:51.650312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:51.706376 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bc326-f1f8-4e5c-9403-012dad4c2c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:51.707507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc326-f1f8-4e5c-9403-012dad4c2c7f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.707983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc326-f1f8-4e5c-9403-012dad4c2c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.708249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc326-f1f8-4e5c-9403-012dad4c2c7f None admin] PATH_INFO: `/v3/projects/207f6da9736a443da019e48a2b2d7633` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.709529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bc326-f1f8-4e5c-9403-012dad4c2c7f None admin] RBAC: Authorizing `identity:get_project(project_id=207f6da9736a443da019e48a2b2d7633)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:51.710973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bc326-f1f8-4e5c-9403-012dad4c2c7f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:51.712773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 161/314] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:51 2022] GET /identity/v3/projects/207f6da9736a443da019e48a2b2d7633 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:51.718398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bc326-f1f8-4e5c-9403-012dad4c2c7f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:51.750263 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48d9ce-8a30-4a6c-b32d-d5225ffac0ff None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:51.789492 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa90b8-79b2-4b48-bdfa-7412138debab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:51.790399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa90b8-79b2-4b48-bdfa-7412138debab None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.790821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa90b8-79b2-4b48-bdfa-7412138debab None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.791189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa90b8-79b2-4b48-bdfa-7412138debab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.805886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa90b8-79b2-4b48-bdfa-7412138debab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-1cfa90b8-79b2-4b48-bdfa-7412138debab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:51.811424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:51.812417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:51.813198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 154/315] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:51.821785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa90b8-79b2-4b48-bdfa-7412138debab None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:51.861074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:51.896884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bc326-f1f8-4e5c-9403-012dad4c2c7f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:51.948907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08f50-28e5-4736-94b2-d0109f36bab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:51.949563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08f50-28e5-4736-94b2-d0109f36bab9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:51.949841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08f50-28e5-4736-94b2-d0109f36bab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:51.950113 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08f50-28e5-4736-94b2-d0109f36bab9 None admin] PATH_INFO: `/v3/groups/7c9b2884b50945789bb542094643e28d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:51.952244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c08f50-28e5-4736-94b2-d0109f36bab9 None admin] RBAC: Authorizing `identity:get_group(group_id=7c9b2884b50945789bb542094643e28d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:51.953632 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c08f50-28e5-4736-94b2-d0109f36bab9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:51.955432 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 162/316] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Oct 24 12:59:51 2022] GET /identity/v3/groups/7c9b2884b50945789bb542094643e28d => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:51.957118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08f50-28e5-4736-94b2-d0109f36bab9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:51.963984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa90b8-79b2-4b48-bdfa-7412138debab None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:52.010427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484d295-67a8-4cd3-8c0d-575c3fbf6d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:52.011083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d295-67a8-4cd3-8c0d-575c3fbf6d18 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:52.011354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d295-67a8-4cd3-8c0d-575c3fbf6d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:52.011680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d295-67a8-4cd3-8c0d-575c3fbf6d18 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:52.013339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484d295-67a8-4cd3-8c0d-575c3fbf6d18 None admin] RBAC: Adding query filter params (name=member) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:52.013659 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484d295-67a8-4cd3-8c0d-575c3fbf6d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:52.015045 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484d295-67a8-4cd3-8c0d-575c3fbf6d18 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:52.024954 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 155/317] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 12:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:52.025868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484d295-67a8-4cd3-8c0d-575c3fbf6d18 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:52.026384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:52.089190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08f50-28e5-4736-94b2-d0109f36bab9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:52.132693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d424f-38ad-4276-bce9-7492f11622ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:52.133355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d424f-38ad-4276-bce9-7492f11622ab None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:52.133662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d424f-38ad-4276-bce9-7492f11622ab None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:52.133894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d424f-38ad-4276-bce9-7492f11622ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:52.144893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d424f-38ad-4276-bce9-7492f11622ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:52.147499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-d42d424f-38ad-4276-bce9-7492f11622ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:52.151901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:52.153046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:52.153836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 163/318] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 12:59:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:52.154476 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d424f-38ad-4276-bce9-7492f11622ab None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:52.163084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484d295-67a8-4cd3-8c0d-575c3fbf6d18 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:52.208219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5d001-102e-42fa-a070-77ffc4fd152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:52.208888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d001-102e-42fa-a070-77ffc4fd152a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:52.209171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d001-102e-42fa-a070-77ffc4fd152a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:52.211292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d001-102e-42fa-a070-77ffc4fd152a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:52.211292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5d001-102e-42fa-a070-77ffc4fd152a None admin] RBAC: Adding query filter params (group.id=7c9b2884b50945789bb542094643e28d, role.id=e1bfcdd2169d4f49bb8a72e8dd7c33cf, scope.project.id=207f6da9736a443da019e48a2b2d7633) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:52.211292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5d001-102e-42fa-a070-77ffc4fd152a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:52.212459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5d001-102e-42fa-a070-77ffc4fd152a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:52.218863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 156/319] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Oct 24 12:59:52 2022] GET /identity/v3/role_assignments?group.id=7c9b2884b50945789bb542094643e28d&scope.project.id=207f6da9736a443da019e48a2b2d7633&role.id=e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:52.219682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5d001-102e-42fa-a070-77ffc4fd152a None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:52.300516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d424f-38ad-4276-bce9-7492f11622ab None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:52.302576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:52.339621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d6ab-bf0d-4996-897f-6dd049c2e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:52.340429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d6ab-bf0d-4996-897f-6dd049c2e725 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:52.340535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d6ab-bf0d-4996-897f-6dd049c2e725 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:52.340732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d6ab-bf0d-4996-897f-6dd049c2e725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:52.358303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5d001-102e-42fa-a070-77ffc4fd152a None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:52.406254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e45ac-4ab2-4f68-803d-88a0452cd69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:52.406912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e45ac-4ab2-4f68-803d-88a0452cd69f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:52.407199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e45ac-4ab2-4f68-803d-88a0452cd69f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:52.407476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e45ac-4ab2-4f68-803d-88a0452cd69f None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:52.408159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e45ac-4ab2-4f68-803d-88a0452cd69f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:52.408514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e45ac-4ab2-4f68-803d-88a0452cd69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:52.409907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e45ac-4ab2-4f68-803d-88a0452cd69f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:52.419850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 157/320] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 12:59:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:52.421026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcc513-8396-4782-8dd6-f6f9e6cb2db5 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:52.421404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcc513-8396-4782-8dd6-f6f9e6cb2db5 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:52.422042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcc513-8396-4782-8dd6-f6f9e6cb2db5 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:52.423261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 158/321] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:52.428577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcc513-8396-4782-8dd6-f6f9e6cb2db5 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:52.431204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31d6ab-bf0d-4996-897f-6dd049c2e725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:52.432808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31d6ab-bf0d-4996-897f-6dd049c2e725 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:52.455163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:52.553999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcc513-8396-4782-8dd6-f6f9e6cb2db5 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:52.555338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 164/322] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 12:59:52.556202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffca93e-ad2f-459b-b2ba-7f34fce0115f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:52.561151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffca93e-ad2f-459b-b2ba-7f34fce0115f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:52.561444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffca93e-ad2f-459b-b2ba-7f34fce0115f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:52.568682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:52.585674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8ffca93e-ad2f-459b-b2ba-7f34fce0115f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:52.586968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8ffca93e-ad2f-459b-b2ba-7f34fce0115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:52.599006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991be78b-b604-4f51-a14c-d2efeac97b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:52.599867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991be78b-b604-4f51-a14c-d2efeac97b0b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:52.600150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991be78b-b604-4f51-a14c-d2efeac97b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:52.600452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991be78b-b604-4f51-a14c-d2efeac97b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:52.667403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 165/323] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:52.668221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffca93e-ad2f-459b-b2ba-7f34fce0115f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:52.684955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991be78b-b604-4f51-a14c-d2efeac97b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:52.686407 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991be78b-b604-4f51-a14c-d2efeac97b0b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:52.711030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:52.786014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffca93e-ad2f-459b-b2ba-7f34fce0115f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:52.818410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 159/324] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 12:59:52.819229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991be78b-b604-4f51-a14c-d2efeac97b0b None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:52.827178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:52.831690 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eebf6e-54f8-4db0-8e45-b7d1218b51d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:52.832970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebf6e-54f8-4db0-8e45-b7d1218b51d4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:52.832970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebf6e-54f8-4db0-8e45-b7d1218b51d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:52.832970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebf6e-54f8-4db0-8e45-b7d1218b51d4 None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:52.835886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eebf6e-54f8-4db0-8e45-b7d1218b51d4 None admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:52.836515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eebf6e-54f8-4db0-8e45-b7d1218b51d4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:52.838351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 166/325] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:52 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:52.847064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eebf6e-54f8-4db0-8e45-b7d1218b51d4 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:52.953011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991be78b-b604-4f51-a14c-d2efeac97b0b None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:52.966566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eebf6e-54f8-4db0-8e45-b7d1218b51d4 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:52.973358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:52.990205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8e9d3-b6f4-49d7-9bf7-c7ac664257d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:52.991079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8e9d3-b6f4-49d7-9bf7-c7ac664257d5 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:52.991570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8e9d3-b6f4-49d7-9bf7-c7ac664257d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:52.991847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8e9d3-b6f4-49d7-9bf7-c7ac664257d5 None admin] PATH_INFO: `/v3/projects/e11856399ed04d35ad94267285ab565e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:52.993137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8e9d3-b6f4-49d7-9bf7-c7ac664257d5 None admin] RBAC: Authorizing `identity:get_project(project_id=e11856399ed04d35ad94267285ab565e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:52.994527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8e9d3-b6f4-49d7-9bf7-c7ac664257d5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:52.996640 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 160/326] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:52 2022] GET /identity/v3/projects/e11856399ed04d35ad94267285ab565e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:52.996979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8e9d3-b6f4-49d7-9bf7-c7ac664257d5 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:53.008816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e298b55-7819-43fc-89a6-9933f4911057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:53.009470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298b55-7819-43fc-89a6-9933f4911057 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:53.009752 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298b55-7819-43fc-89a6-9933f4911057 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:53.010027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298b55-7819-43fc-89a6-9933f4911057 None admin] PATH_INFO: `/v3/groups/7c9b2884b50945789bb542094643e28d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:53.011131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e298b55-7819-43fc-89a6-9933f4911057 None admin] RBAC: Authorizing `identity:get_group(group_id=7c9b2884b50945789bb542094643e28d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:53.012614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e298b55-7819-43fc-89a6-9933f4911057 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:53.014211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 167/327] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Oct 24 12:59:52 2022] GET /identity/v3/groups/7c9b2884b50945789bb542094643e28d => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:53.014967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e298b55-7819-43fc-89a6-9933f4911057 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:53.085558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:53.113393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8e9d3-b6f4-49d7-9bf7-c7ac664257d5 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:53.126731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e298b55-7819-43fc-89a6-9933f4911057 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:53.152068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18824df1-6d62-45e0-b0ff-55aaebdc9782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:53.152753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824df1-6d62-45e0-b0ff-55aaebdc9782 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:53.153035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824df1-6d62-45e0-b0ff-55aaebdc9782 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:53.153309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824df1-6d62-45e0-b0ff-55aaebdc9782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:53.162446 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72162b-4aae-43ef-8cd4-c5a85f8a37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:53.163082 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72162b-4aae-43ef-8cd4-c5a85f8a37ca None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:53.163372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72162b-4aae-43ef-8cd4-c5a85f8a37ca None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:53.163469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18824df1-6d62-45e0-b0ff-55aaebdc9782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:53.163640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72162b-4aae-43ef-8cd4-c5a85f8a37ca None admin] PATH_INFO: `/v3/groups/7c9b2884b50945789bb542094643e28d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:53.164737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72162b-4aae-43ef-8cd4-c5a85f8a37ca None admin] RBAC: Authorizing `identity:get_group(group_id=7c9b2884b50945789bb542094643e28d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:53.166176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72162b-4aae-43ef-8cd4-c5a85f8a37ca None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:53.167751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 168/328] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Oct 24 12:59:53 2022] GET /identity/v3/groups/7c9b2884b50945789bb542094643e28d => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-18824df1-6d62-45e0-b0ff-55aaebdc9782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:53.168229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:53.169180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 12:59:53.169967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:53.170562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72162b-4aae-43ef-8cd4-c5a85f8a37ca None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:53.170629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 161/329] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 12:59:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:53.173660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18824df1-6d62-45e0-b0ff-55aaebdc9782 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:53.221765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:53.268515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72162b-4aae-43ef-8cd4-c5a85f8a37ca None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:53.275215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18824df1-6d62-45e0-b0ff-55aaebdc9782 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:53.301597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c9af0-dfc5-43d4-8c20-e25f8f3c26a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:53.302211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c9af0-dfc5-43d4-8c20-e25f8f3c26a5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:53.302482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c9af0-dfc5-43d4-8c20-e25f8f3c26a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:53.302753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c9af0-dfc5-43d4-8c20-e25f8f3c26a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:53.303476 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c9af0-dfc5-43d4-8c20-e25f8f3c26a5 None admin] RBAC: Adding query filter params (group.id=7c9b2884b50945789bb542094643e28d, role.id=5a473059a779480ca6031449b18aeb52, scope.project.id=e11856399ed04d35ad94267285ab565e) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:53.303780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c9af0-dfc5-43d4-8c20-e25f8f3c26a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:53.305241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c9af0-dfc5-43d4-8c20-e25f8f3c26a5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:53.307947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:53.308765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbdc9b-6804-4486-9466-77debcb4183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:53.309273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbdc9b-6804-4486-9466-77debcb4183e None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:53.309621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbdc9b-6804-4486-9466-77debcb4183e None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:53.309882 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbdc9b-6804-4486-9466-77debcb4183e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:53.310614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbdc9b-6804-4486-9466-77debcb4183e None admin] RBAC: Adding query filter params (group.id=7c9b2884b50945789bb542094643e28d, role.id=e1bfcdd2169d4f49bb8a72e8dd7c33cf, scope.project.id=e11856399ed04d35ad94267285ab565e) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:53.310925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbdc9b-6804-4486-9466-77debcb4183e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:53.311098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 169/330] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Oct 24 12:59:53 2022] GET /identity/v3/role_assignments?group.id=7c9b2884b50945789bb542094643e28d&scope.project.id=e11856399ed04d35ad94267285ab565e&role.id=5a473059a779480ca6031449b18aeb52 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:53.312707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbdc9b-6804-4486-9466-77debcb4183e None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:53.313126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c9af0-dfc5-43d4-8c20-e25f8f3c26a5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:53.320186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 162/331] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Oct 24 12:59:53 2022] GET /identity/v3/role_assignments?group.id=7c9b2884b50945789bb542094643e28d&scope.project.id=e11856399ed04d35ad94267285ab565e&role.id=e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:53.443111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c9af0-dfc5-43d4-8c20-e25f8f3c26a5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:53.485598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc68f19-04f4-4ffa-bcdd-e8641e21d3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:53.486493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc68f19-04f4-4ffa-bcdd-e8641e21d3cf None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:53.486931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc68f19-04f4-4ffa-bcdd-e8641e21d3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:53.487345 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc68f19-04f4-4ffa-bcdd-e8641e21d3cf None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:53.488202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc68f19-04f4-4ffa-bcdd-e8641e21d3cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:53.488748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc68f19-04f4-4ffa-bcdd-e8641e21d3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:53.490307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc68f19-04f4-4ffa-bcdd-e8641e21d3cf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:53.500658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 170/332] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 12:59:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:53.507133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbdc9b-6804-4486-9466-77debcb4183e None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:53.619000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbdc9b-6804-4486-9466-77debcb4183e None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:53.632131 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:53.654405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4e11-15e6-4e20-beaf-ee88a7e0b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:53.655028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4e11-15e6-4e20-beaf-ee88a7e0b9cd None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:53.655306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4e11-15e6-4e20-beaf-ee88a7e0b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:53.655581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4e11-15e6-4e20-beaf-ee88a7e0b9cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:53.724956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d4e11-15e6-4e20-beaf-ee88a7e0b9cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:53.726412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d4e11-15e6-4e20-beaf-ee88a7e0b9cd None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:53.824033 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 163/333] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 12:59:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 12:59:53.829775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc68f19-04f4-4ffa-bcdd-e8641e21d3cf None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:53.891872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:53.935473 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc68f19-04f4-4ffa-bcdd-e8641e21d3cf None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:53.971770 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01286c-f313-40cc-b10c-33e1ef8a9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:53.972418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01286c-f313-40cc-b10c-33e1ef8a9dcd None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:53.972697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01286c-f313-40cc-b10c-33e1ef8a9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:53.973044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01286c-f313-40cc-b10c-33e1ef8a9dcd None admin] PATH_INFO: `/v3/projects/137e4bed4da241048e2ccc51fb5ebefa` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:53.974231 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01286c-f313-40cc-b10c-33e1ef8a9dcd None admin] RBAC: Authorizing `identity:get_project(project_id=137e4bed4da241048e2ccc51fb5ebefa)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:53.975670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01286c-f313-40cc-b10c-33e1ef8a9dcd None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:53.977339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 171/334] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 12:59:53 2022] GET /identity/v3/projects/137e4bed4da241048e2ccc51fb5ebefa => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:53.983290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4e11-15e6-4e20-beaf-ee88a7e0b9cd None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:53.999054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:54.089043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4e11-15e6-4e20-beaf-ee88a7e0b9cd None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:54.125038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf382c02-8669-4dae-a763-65da3a13c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:54.125659 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382c02-8669-4dae-a763-65da3a13c80f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:54.125936 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382c02-8669-4dae-a763-65da3a13c80f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:54.126214 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382c02-8669-4dae-a763-65da3a13c80f None admin] PATH_INFO: `/v3/groups/36f873898bbd46d8872e86caf95c84f8` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:54.127431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf382c02-8669-4dae-a763-65da3a13c80f None admin] RBAC: Authorizing `identity:get_group(group_id=36f873898bbd46d8872e86caf95c84f8)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:54.128908 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf382c02-8669-4dae-a763-65da3a13c80f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:54.130521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 164/335] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Oct 24 12:59:53 2022] GET /identity/v3/groups/36f873898bbd46d8872e86caf95c84f8 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:54.139382 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01286c-f313-40cc-b10c-33e1ef8a9dcd None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:54.241251 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01286c-f313-40cc-b10c-33e1ef8a9dcd None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:54.270186 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:54.277758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21e1f0-4287-4477-8b08-e39a02155b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:54.278361 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21e1f0-4287-4477-8b08-e39a02155b79 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:54.278644 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21e1f0-4287-4477-8b08-e39a02155b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:54.278919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21e1f0-4287-4477-8b08-e39a02155b79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:54.279665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21e1f0-4287-4477-8b08-e39a02155b79 None admin] RBAC: Adding query filter params (group.id=36f873898bbd46d8872e86caf95c84f8, role.id=67447f88528849c59df641acc7768c92, scope.project.id=137e4bed4da241048e2ccc51fb5ebefa) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:54.279969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21e1f0-4287-4477-8b08-e39a02155b79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:54.281447 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21e1f0-4287-4477-8b08-e39a02155b79 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:54.287628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 172/336] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Oct 24 12:59:54 2022] GET /identity/v3/role_assignments?group.id=36f873898bbd46d8872e86caf95c84f8&scope.project.id=137e4bed4da241048e2ccc51fb5ebefa&role.id=67447f88528849c59df641acc7768c92 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 12:59:56.871884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0192b-7c11-418d-9277-054e04ef31b1 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:56.872487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0192b-7c11-418d-9277-054e04ef31b1 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:56.872487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0192b-7c11-418d-9277-054e04ef31b1 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:56.874483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 165/337] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:56.879757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe320187-edb1-4837-9807-a98c9b00fe42 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:56.880223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe320187-edb1-4837-9807-a98c9b00fe42 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:56.880323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe320187-edb1-4837-9807-a98c9b00fe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:56.909369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-fe320187-edb1-4837-9807-a98c9b00fe42 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:56.910614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fe320187-edb1-4837-9807-a98c9b00fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:56.965879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b8ee1-bc4c-40d7-b00f-3e8e05041c35 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:56.966888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b8ee1-bc4c-40d7-b00f-3e8e05041c35 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:56.967363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b8ee1-bc4c-40d7-b00f-3e8e05041c35 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:56.969271 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 166/338] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 12:59:56.974367 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8490da-1af4-45f5-afa8-b517e506b174 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:56.975005 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8490da-1af4-45f5-afa8-b517e506b174 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:56.975480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8490da-1af4-45f5-afa8-b517e506b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:56.993635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-6a8490da-1af4-45f5-afa8-b517e506b174 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:56.995215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6a8490da-1af4-45f5-afa8-b517e506b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:57.014625 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 173/339] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:57.065871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 167/340] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 12:59:57.203407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297677a-db68-41ac-bb3a-3593bf96da79 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.203760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297677a-db68-41ac-bb3a-3593bf96da79 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.203972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297677a-db68-41ac-bb3a-3593bf96da79 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:57.205683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 174/341] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:57.217668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc8783-cd07-4af1-83b2-d81147a67065 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.218290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc8783-cd07-4af1-83b2-d81147a67065 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.218759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc8783-cd07-4af1-83b2-d81147a67065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:57.244877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-0efc8783-cd07-4af1-83b2-d81147a67065 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:57.246420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0efc8783-cd07-4af1-83b2-d81147a67065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:57.253265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:57.335812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 168/342] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:57.387058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297677a-db68-41ac-bb3a-3593bf96da79 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:57.460811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc8783-cd07-4af1-83b2-d81147a67065 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:57.537906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297677a-db68-41ac-bb3a-3593bf96da79 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:57.568330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc8783-cd07-4af1-83b2-d81147a67065 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:57.587673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:57.606060 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b4449-01b0-4c6c-8751-b2ac97a1ad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:57.607040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b4449-01b0-4c6c-8751-b2ac97a1ad78 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.607511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b4449-01b0-4c6c-8751-b2ac97a1ad78 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.607961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b4449-01b0-4c6c-8751-b2ac97a1ad78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:57.619127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b4449-01b0-4c6c-8751-b2ac97a1ad78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:57.620875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b4449-01b0-4c6c-8751-b2ac97a1ad78 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:57.620979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dc1fe-d38d-4806-9a50-9cdb0cc77684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:57.621626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dc1fe-d38d-4806-9a50-9cdb0cc77684 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.621924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dc1fe-d38d-4806-9a50-9cdb0cc77684 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.622182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dc1fe-d38d-4806-9a50-9cdb0cc77684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:57.630170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:57.637903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791dc1fe-d38d-4806-9a50-9cdb0cc77684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:57.639389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791dc1fe-d38d-4806-9a50-9cdb0cc77684 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-9a2b4449-01b0-4c6c-8751-b2ac97a1ad78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 12:59:57.641280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:57.642204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 12:59:57.643081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 12:59:57.643081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:57.643081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:57.645245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 169/343] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 12:59:57.650932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b4449-01b0-4c6c-8751-b2ac97a1ad78 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-791dc1fe-d38d-4806-9a50-9cdb0cc77684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 12:59:57.656918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:57.657787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 12:59:57.658657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 12:59:57.658657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:57.658657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:57.663499 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 175/344] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:57.663978 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dc1fe-d38d-4806-9a50-9cdb0cc77684 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:57.778444 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b4449-01b0-4c6c-8751-b2ac97a1ad78 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:57.791719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dc1fe-d38d-4806-9a50-9cdb0cc77684 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:57.813258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b07ee1-97a7-47c8-b25d-ebd1e5535dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:57.814374 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07ee1-97a7-47c8-b25d-ebd1e5535dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.814662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07ee1-97a7-47c8-b25d-ebd1e5535dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.814941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07ee1-97a7-47c8-b25d-ebd1e5535dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:57.826953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b07ee1-97a7-47c8-b25d-ebd1e5535dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:57.828497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b07ee1-97a7-47c8-b25d-ebd1e5535dc6 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:57.829827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614d98-ee6c-42b7-a27c-3999b3b94e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:57.830497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614d98-ee6c-42b7-a27c-3999b3b94e19 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.830780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614d98-ee6c-42b7-a27c-3999b3b94e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.831067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614d98-ee6c-42b7-a27c-3999b3b94e19 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:57.831698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12614d98-ee6c-42b7-a27c-3999b3b94e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:57.831996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12614d98-ee6c-42b7-a27c-3999b3b94e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:57.833746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12614d98-ee6c-42b7-a27c-3999b3b94e19 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-74b07ee1-97a7-47c8-b25d-ebd1e5535dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 12:59:57.843518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:57.845216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 12:59:57.846071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 12:59:57.846071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:57.846071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:57.846071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 170/345] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:57.850430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b07ee1-97a7-47c8-b25d-ebd1e5535dc6 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:57.854725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 176/346] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 12:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:57.857597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533b1e1-cf16-4aef-8b3b-35bbacef828f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:57.857876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533b1e1-cf16-4aef-8b3b-35bbacef828f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:57.858243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533b1e1-cf16-4aef-8b3b-35bbacef828f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:57.859710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 177/347] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:57.860477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533b1e1-cf16-4aef-8b3b-35bbacef828f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:57.901410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:57.908023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:57.969370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533b1e1-cf16-4aef-8b3b-35bbacef828f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:57.969711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b07ee1-97a7-47c8-b25d-ebd1e5535dc6 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:58.003361 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e07d92-5c4e-4548-98f3-0eaff7fde520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.003689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108e256-eab1-4a66-999a-43017bfb973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.003971 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e07d92-5c4e-4548-98f3-0eaff7fde520 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.004313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e07d92-5c4e-4548-98f3-0eaff7fde520 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.004417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e256-eab1-4a66-999a-43017bfb973b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.004597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e07d92-5c4e-4548-98f3-0eaff7fde520 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.004701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e256-eab1-4a66-999a-43017bfb973b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.004897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e256-eab1-4a66-999a-43017bfb973b None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.005232 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e07d92-5c4e-4548-98f3-0eaff7fde520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:58.005529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e07d92-5c4e-4548-98f3-0eaff7fde520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:58.005624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108e256-eab1-4a66-999a-43017bfb973b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:58.005837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108e256-eab1-4a66-999a-43017bfb973b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:58.006889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e07d92-5c4e-4548-98f3-0eaff7fde520 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:58.007211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108e256-eab1-4a66-999a-43017bfb973b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:58.018688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 178/348] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 12:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:58.019277 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e07d92-5c4e-4548-98f3-0eaff7fde520 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.027964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 171/349] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 12:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:58.027964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24d0c-c969-4eb6-bc27-dac51f3d95ec None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.027964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24d0c-c969-4eb6-bc27-dac51f3d95ec None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.027964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24d0c-c969-4eb6-bc27-dac51f3d95ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.044755 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ccb24d0c-c969-4eb6-bc27-dac51f3d95ec None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:58.045876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ccb24d0c-c969-4eb6-bc27-dac51f3d95ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:58.117066 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 172/350] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:58.118002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb24d0c-c969-4eb6-bc27-dac51f3d95ec None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.132146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:58.138786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e07d92-5c4e-4548-98f3-0eaff7fde520 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:58.168074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:58.172580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4f13f-01fb-404c-9c60-0d2a4dee1646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.173293 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4f13f-01fb-404c-9c60-0d2a4dee1646 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.173638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4f13f-01fb-404c-9c60-0d2a4dee1646 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.173973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4f13f-01fb-404c-9c60-0d2a4dee1646 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.174688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4f13f-01fb-404c-9c60-0d2a4dee1646 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:58.176230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4f13f-01fb-404c-9c60-0d2a4dee1646 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:58.209065 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 179/351] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:58 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:58.211365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4f13f-01fb-404c-9c60-0d2a4dee1646 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.293089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb24d0c-c969-4eb6-bc27-dac51f3d95ec None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:58.376586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7336c6-54f9-43b9-b3cb-a10e3630b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.377548 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7336c6-54f9-43b9-b3cb-a10e3630b53a None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.378023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7336c6-54f9-43b9-b3cb-a10e3630b53a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.378530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7336c6-54f9-43b9-b3cb-a10e3630b53a None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.379456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7336c6-54f9-43b9-b3cb-a10e3630b53a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:58.382510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7336c6-54f9-43b9-b3cb-a10e3630b53a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:58.424323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 173/352] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:58 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:58.424323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7336c6-54f9-43b9-b3cb-a10e3630b53a None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.424624 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4f13f-01fb-404c-9c60-0d2a4dee1646 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:58.463973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fac88c-2ef5-4816-8a41-82ecc686891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.464627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fac88c-2ef5-4816-8a41-82ecc686891a None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.464905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fac88c-2ef5-4816-8a41-82ecc686891a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.465356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fac88c-2ef5-4816-8a41-82ecc686891a None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.466044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fac88c-2ef5-4816-8a41-82ecc686891a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:58.467996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fac88c-2ef5-4816-8a41-82ecc686891a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:58.496078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 180/353] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:58 2022] POST /identity/v3/users => generated 246 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 12:59:58.562232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:58.578119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7336c6-54f9-43b9-b3cb-a10e3630b53a None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:58.636034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cebb29-4a49-4942-8b15-d24b866f00f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.636676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cebb29-4a49-4942-8b15-d24b866f00f6 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.636952 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cebb29-4a49-4942-8b15-d24b866f00f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.637225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cebb29-4a49-4942-8b15-d24b866f00f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.650793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cebb29-4a49-4942-8b15-d24b866f00f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:58.652343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cebb29-4a49-4942-8b15-d24b866f00f6 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-f5cebb29-4a49-4942-8b15-d24b866f00f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 12:59:58.668775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:58.669757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 12:59:58.670689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 12:59:58.670689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 12:59:58.670689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:58.670689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 174/354] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 12:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:58.676703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fac88c-2ef5-4816-8a41-82ecc686891a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.689695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:58.755430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ee9e0-46b2-41e8-9d94-fc8d5a33ebee None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.755736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ee9e0-46b2-41e8-9d94-fc8d5a33ebee None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.756034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ee9e0-46b2-41e8-9d94-fc8d5a33ebee None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.757624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 175/355] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 12:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 12:59:58.763814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37168-93e4-4b44-8c88-780925416a0f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.764097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37168-93e4-4b44-8c88-780925416a0f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.764411 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37168-93e4-4b44-8c88-780925416a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.784535 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-37d37168-93e4-4b44-8c88-780925416a0f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 12:59:58.785868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-37d37168-93e4-4b44-8c88-780925416a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 12:59:58.803774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fac88c-2ef5-4816-8a41-82ecc686891a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:58.849010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8f4f2-cdb4-4057-b12b-ed5870419b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:58.850114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8f4f2-cdb4-4057-b12b-ed5870419b59 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:58.850517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8f4f2-cdb4-4057-b12b-ed5870419b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:58.850884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8f4f2-cdb4-4057-b12b-ed5870419b59 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:58.851680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8f4f2-cdb4-4057-b12b-ed5870419b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:58.852095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8f4f2-cdb4-4057-b12b-ed5870419b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:58.855369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8f4f2-cdb4-4057-b12b-ed5870419b59 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:58.870584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 181/356] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 12:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 12:59:58.872117 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 176/357] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 12:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 12:59:58.877592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8f4f2-cdb4-4057-b12b-ed5870419b59 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:58.947158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:58.982805 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8f4f2-cdb4-4057-b12b-ed5870419b59 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.018445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b775e4-3437-45dc-a86a-917c651111bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.019117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b775e4-3437-45dc-a86a-917c651111bd None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.019394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b775e4-3437-45dc-a86a-917c651111bd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.019709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b775e4-3437-45dc-a86a-917c651111bd None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.020438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b775e4-3437-45dc-a86a-917c651111bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.021871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b775e4-3437-45dc-a86a-917c651111bd None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.045237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 182/358] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 12:59:58 2022] POST /identity/v3/users => generated 249 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 12:59:59.221555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d37168-93e4-4b44-8c88-780925416a0f None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.305169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.344140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d37168-93e4-4b44-8c88-780925416a0f None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.379646 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbb6f3-c4c9-4842-a7fd-73a0f8ec8862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.380643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbb6f3-c4c9-4842-a7fd-73a0f8ec8862 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.381144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbb6f3-c4c9-4842-a7fd-73a0f8ec8862 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.381620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbb6f3-c4c9-4842-a7fd-73a0f8ec8862 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.382559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbb6f3-c4c9-4842-a7fd-73a0f8ec8862 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.384135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbb6f3-c4c9-4842-a7fd-73a0f8ec8862 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.396152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.sql.core [None req-51bbb6f3-c4c9-4842-a7fd-73a0f8ec8862 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 12:59:59.396152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 24 12:59:59.396152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [parameters: {'id': '62da68a5dbce4ba988772d6cb785d0f6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 24 12:59:59.396152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81636) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-51bbb6f3-c4c9-4842-a7fd-73a0f8ec8862 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application conn.query(q) Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result.read() Oct 24 12:59:59.403540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return ref.to_dict() Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 12:59:59.404617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application next(self.gen) Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application yield resource Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application next(self.gen) Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise self.value Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application session.commit() Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 12:59:59.405775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.session.flush() Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application compat.raise_( Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 12:59:59.406833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 12:59:59.407903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application conn.query(q) Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result.read() Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 12:59:59.408751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [parameters: {'id': '62da68a5dbce4ba988772d6cb785d0f6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:59.409558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 24 12:59:59.410413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 12:59:59.412983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 177/359] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Oct 24 12:59:59 2022] POST /identity/v3/roles => generated 144 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:59.419097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b775e4-3437-45dc-a86a-917c651111bd None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.537566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b775e4-3437-45dc-a86a-917c651111bd None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.565345 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.579653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dea54-21a1-41c6-9a11-3aca6353b578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.580820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dea54-21a1-41c6-9a11-3aca6353b578 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.581317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dea54-21a1-41c6-9a11-3aca6353b578 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.581757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dea54-21a1-41c6-9a11-3aca6353b578 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.593105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dea54-21a1-41c6-9a11-3aca6353b578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-8c7dea54-21a1-41c6-9a11-3aca6353b578 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 12:59:59.598903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 12:59:59.599807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 12:59:59.600646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 12:59:59.602937 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 183/360] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 12:59:59.609078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbb6f3-c4c9-4842-a7fd-73a0f8ec8862 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 12:59:59.710887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbb6f3-c4c9-4842-a7fd-73a0f8ec8862 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 12:59:59.745305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbb25a-c5c5-42b3-8ce2-208256c27e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 12:59:59.746188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbb25a-c5c5-42b3-8ce2-208256c27e47 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 12:59:59.746604 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbb25a-c5c5-42b3-8ce2-208256c27e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 12:59:59.747104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbb25a-c5c5-42b3-8ce2-208256c27e47 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 12:59:59.748279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbb25a-c5c5-42b3-8ce2-208256c27e47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 12:59:59.748770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbb25a-c5c5-42b3-8ce2-208256c27e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 12:59:59.750347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbb25a-c5c5-42b3-8ce2-208256c27e47 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 12:59:59.752952 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:59:59.759478 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 178/361] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 12:59:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:00.796163 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3fb04-afa2-4b6b-95b3-f3ec7baf30f1 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:00.796723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3fb04-afa2-4b6b-95b3-f3ec7baf30f1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:00.796723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3fb04-afa2-4b6b-95b3-f3ec7baf30f1 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:00.798379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 184/362] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:00.803988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b116-2da4-448e-9957-0e7db8adc9ae None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:00.804451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b116-2da4-448e-9957-0e7db8adc9ae None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:00.804636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b116-2da4-448e-9957-0e7db8adc9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:00.832655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-2441b116-2da4-448e-9957-0e7db8adc9ae None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:00.833875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2441b116-2da4-448e-9957-0e7db8adc9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:00.936696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 179/363] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:01.039109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdabc7-db0f-4b54-8a36-39024a503823 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:01.039438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdabc7-db0f-4b54-8a36-39024a503823 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:01.039652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdabc7-db0f-4b54-8a36-39024a503823 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:01.041306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 185/364] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:01.046587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98945df-84c9-452f-a6c3-40d7aa17a4bf None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:01.046811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98945df-84c9-452f-a6c3-40d7aa17a4bf None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:01.047079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98945df-84c9-452f-a6c3-40d7aa17a4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:01.065311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b98945df-84c9-452f-a6c3-40d7aa17a4bf None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:01.066852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b98945df-84c9-452f-a6c3-40d7aa17a4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:01.168818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 180/365] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:01.336712 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdabc7-db0f-4b54-8a36-39024a503823 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:01.398059 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467eab-1752-4fde-93c6-8bbeeab41606 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:01.398387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467eab-1752-4fde-93c6-8bbeeab41606 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:01.398881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467eab-1752-4fde-93c6-8bbeeab41606 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:01.400981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 181/366] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:01.405971 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2e442-226e-47f5-99a8-bde7ea67de0e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:01.406414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2e442-226e-47f5-99a8-bde7ea67de0e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:01.406841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2e442-226e-47f5-99a8-bde7ea67de0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:01.426889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b1b2e442-226e-47f5-99a8-bde7ea67de0e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:01.428191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b1b2e442-226e-47f5-99a8-bde7ea67de0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:01.488414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdabc7-db0f-4b54-8a36-39024a503823 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:01.503801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:01.520871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 182/367] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:01.521752 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2e442-226e-47f5-99a8-bde7ea67de0e None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:01.533029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ef04c-6b83-4926-a13b-293400b3c9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:01.533697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ef04c-6b83-4926-a13b-293400b3c9ed None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:01.533975 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ef04c-6b83-4926-a13b-293400b3c9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:01.534238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ef04c-6b83-4926-a13b-293400b3c9ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:01.545413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ef04c-6b83-4926-a13b-293400b3c9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-8f0ef04c-6b83-4926-a13b-293400b3c9ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:01.550286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:01.551289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:01.552100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 186/368] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:01.560681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ef04c-6b83-4926-a13b-293400b3c9ed None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:01.662969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:01.675447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2e442-226e-47f5-99a8-bde7ea67de0e None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:01.740387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c490131-1deb-4f4b-81de-9d6c150b4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:01.741031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c490131-1deb-4f4b-81de-9d6c150b4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:01.741370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c490131-1deb-4f4b-81de-9d6c150b4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:01.741648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c490131-1deb-4f4b-81de-9d6c150b4eb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:01.753238 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c490131-1deb-4f4b-81de-9d6c150b4eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-1c490131-1deb-4f4b-81de-9d6c150b4eb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:01.758366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:01.759216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:01.760022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 183/369] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:01.763526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ef04c-6b83-4926-a13b-293400b3c9ed None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:01.766509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c490131-1deb-4f4b-81de-9d6c150b4eb1 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:01.829316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad13fa5-2b28-4343-bfa9-07276ce04270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:01.829996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad13fa5-2b28-4343-bfa9-07276ce04270 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:01.831039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad13fa5-2b28-4343-bfa9-07276ce04270 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:01.831354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad13fa5-2b28-4343-bfa9-07276ce04270 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:01.834142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad13fa5-2b28-4343-bfa9-07276ce04270 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:01.834462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad13fa5-2b28-4343-bfa9-07276ce04270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:01.835869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad13fa5-2b28-4343-bfa9-07276ce04270 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:01.860326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 187/370] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:01.864802 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad13fa5-2b28-4343-bfa9-07276ce04270 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:01.868007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:01.930455 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c490131-1deb-4f4b-81de-9d6c150b4eb1 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:01.973219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e416d04-97b6-496c-a5d2-c087ab455181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:01.973907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e416d04-97b6-496c-a5d2-c087ab455181 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:01.974258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e416d04-97b6-496c-a5d2-c087ab455181 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:01.974534 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e416d04-97b6-496c-a5d2-c087ab455181 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:01.975483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e416d04-97b6-496c-a5d2-c087ab455181 None admin] RBAC: Adding query filter params (name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:01.975789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e416d04-97b6-496c-a5d2-c087ab455181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:01.978108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e416d04-97b6-496c-a5d2-c087ab455181 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:01.990321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 184/371] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:01.991492 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e416d04-97b6-496c-a5d2-c087ab455181 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.004117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad13fa5-2b28-4343-bfa9-07276ce04270 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.014158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:02.049944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433ecf1-0027-4ea6-b68b-74a5d5e9603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.051273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433ecf1-0027-4ea6-b68b-74a5d5e9603a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.051726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433ecf1-0027-4ea6-b68b-74a5d5e9603a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.052441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433ecf1-0027-4ea6-b68b-74a5d5e9603a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.066209 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433ecf1-0027-4ea6-b68b-74a5d5e9603a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-8433ecf1-0027-4ea6-b68b-74a5d5e9603a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:02.073755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:02.074658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:02.075452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:02.083376 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 188/372] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:02.084995 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433ecf1-0027-4ea6-b68b-74a5d5e9603a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.112890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e416d04-97b6-496c-a5d2-c087ab455181 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.124443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:02.149844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5909d-5b4d-49a3-bf88-652a0c475884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.150389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5909d-5b4d-49a3-bf88-652a0c475884 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.150668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5909d-5b4d-49a3-bf88-652a0c475884 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.150945 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5909d-5b4d-49a3-bf88-652a0c475884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.162087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5909d-5b4d-49a3-bf88-652a0c475884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:02.163538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5909d-5b4d-49a3-bf88-652a0c475884 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-4fb5909d-5b4d-49a3-bf88-652a0c475884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:02.179691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:02.180719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:02.182107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:02.182107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:02.182107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:02.182107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 185/373] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:02.185769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5909d-5b4d-49a3-bf88-652a0c475884 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.199906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433ecf1-0027-4ea6-b68b-74a5d5e9603a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.233337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee63e6-0d9e-423d-852b-ed641257f05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.233974 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee63e6-0d9e-423d-852b-ed641257f05b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.234250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee63e6-0d9e-423d-852b-ed641257f05b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.234516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee63e6-0d9e-423d-852b-ed641257f05b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.245236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee63e6-0d9e-423d-852b-ed641257f05b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:02.246428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee63e6-0d9e-423d-852b-ed641257f05b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-03ee63e6-0d9e-423d-852b-ed641257f05b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:02.261461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:02.262369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:02.263240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:02.263240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:02.263240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:02.263240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 189/374] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:02.264117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17d468-c9cc-4a28-aa62-8e6e0e4bd401 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.264427 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17d468-c9cc-4a28-aa62-8e6e0e4bd401 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.264698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17d468-c9cc-4a28-aa62-8e6e0e4bd401 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.266160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 190/375] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:02.266854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17d468-c9cc-4a28-aa62-8e6e0e4bd401 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.288317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:02.299165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5909d-5b4d-49a3-bf88-652a0c475884 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.333812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82affd78-ad35-4709-ac03-9e9bab394ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.334454 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82affd78-ad35-4709-ac03-9e9bab394ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.334729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82affd78-ad35-4709-ac03-9e9bab394ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.335000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82affd78-ad35-4709-ac03-9e9bab394ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.335664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82affd78-ad35-4709-ac03-9e9bab394ed9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:02.335966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82affd78-ad35-4709-ac03-9e9bab394ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:02.337390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82affd78-ad35-4709-ac03-9e9bab394ed9 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:02.345572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 186/376] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:02.346370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82affd78-ad35-4709-ac03-9e9bab394ed9 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.374015 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:02.384718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17d468-c9cc-4a28-aa62-8e6e0e4bd401 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.422348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb190f-8203-4133-b548-931a2a53b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.422983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb190f-8203-4133-b548-931a2a53b9fd None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.423259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb190f-8203-4133-b548-931a2a53b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.423526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb190f-8203-4133-b548-931a2a53b9fd None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.424192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb190f-8203-4133-b548-931a2a53b9fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:02.424532 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb190f-8203-4133-b548-931a2a53b9fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:02.426031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb190f-8203-4133-b548-931a2a53b9fd None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:02.444069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 191/377] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:02.444069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7311-09a8-403d-9285-f3c6c392dcb8 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.444069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7311-09a8-403d-9285-f3c6c392dcb8 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.444069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7311-09a8-403d-9285-f3c6c392dcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.458781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82affd78-ad35-4709-ac03-9e9bab394ed9 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.460484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-903f7311-09a8-403d-9285-f3c6c392dcb8 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:02.461793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-903f7311-09a8-403d-9285-f3c6c392dcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:02.498311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03208c32-da28-41df-9e4e-a409ce72e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.499283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03208c32-da28-41df-9e4e-a409ce72e769 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.499562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03208c32-da28-41df-9e4e-a409ce72e769 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.499832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03208c32-da28-41df-9e4e-a409ce72e769 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.500500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03208c32-da28-41df-9e4e-a409ce72e769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:02.500801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03208c32-da28-41df-9e4e-a409ce72e769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:02.502176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03208c32-da28-41df-9e4e-a409ce72e769 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:02.514057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 187/378] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:02.514786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03208c32-da28-41df-9e4e-a409ce72e769 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.542327 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 192/379] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:02.542327 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f7311-09a8-403d-9285-f3c6c392dcb8 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.545924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:02.604758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:02.621384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03208c32-da28-41df-9e4e-a409ce72e769 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.648017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f7311-09a8-403d-9285-f3c6c392dcb8 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.656921 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32bb50-ce33-46f9-a35b-c2c2b0b1c507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.657862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32bb50-ce33-46f9-a35b-c2c2b0b1c507 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.658156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32bb50-ce33-46f9-a35b-c2c2b0b1c507 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.659030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32bb50-ce33-46f9-a35b-c2c2b0b1c507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.669610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32bb50-ce33-46f9-a35b-c2c2b0b1c507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:02.671145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32bb50-ce33-46f9-a35b-c2c2b0b1c507 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:02.685294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e1346-651c-471a-8cc5-91f712f5f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.685936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e1346-651c-471a-8cc5-91f712f5f8da None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-5e32bb50-ce33-46f9-a35b-c2c2b0b1c507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:02.686193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:02.687069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:02.687934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:02.687934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:02.687934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:02.688097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e1346-651c-471a-8cc5-91f712f5f8da None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.688097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e1346-651c-471a-8cc5-91f712f5f8da None admin] PATH_INFO: `/v3/users/glance` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.688213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 188/380] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:02.688213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32bb50-ce33-46f9-a35b-c2c2b0b1c507 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.700720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e1346-651c-471a-8cc5-91f712f5f8da None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:02.702104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e1346-651c-471a-8cc5-91f712f5f8da None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-f88e1346-651c-471a-8cc5-91f712f5f8da None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:02.715310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:02.716472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:02.717599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:02.717599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:02.717599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:02.717599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:02.717599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:02.717599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:02.717599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:02.717599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:02.717599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:00:02.717599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:02.721122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 193/381] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:02.722146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577d8c2-1407-404b-ae2b-039b5090c46f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.722422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577d8c2-1407-404b-ae2b-039b5090c46f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.722697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577d8c2-1407-404b-ae2b-039b5090c46f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.728365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 194/382] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:02.728365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577d8c2-1407-404b-ae2b-039b5090c46f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.796103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32bb50-ce33-46f9-a35b-c2c2b0b1c507 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.798336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:02.829564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7b9c6-694d-4cfa-a1ce-02f420b74167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.830193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7b9c6-694d-4cfa-a1ce-02f420b74167 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.830468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7b9c6-694d-4cfa-a1ce-02f420b74167 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.830765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7b9c6-694d-4cfa-a1ce-02f420b74167 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.831574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577d8c2-1407-404b-ae2b-039b5090c46f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.834087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:02.840759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7b9c6-694d-4cfa-a1ce-02f420b74167 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:02.842585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7b9c6-694d-4cfa-a1ce-02f420b74167 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-c9e7b9c6-694d-4cfa-a1ce-02f420b74167 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:02.855450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:02.856412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 189/383] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:02.857807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7b9c6-694d-4cfa-a1ce-02f420b74167 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.866730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4eae6-f28a-447a-978b-348c641f28f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.867345 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4eae6-f28a-447a-978b-348c641f28f9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.867621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4eae6-f28a-447a-978b-348c641f28f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.867890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4eae6-f28a-447a-978b-348c641f28f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.868566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4eae6-f28a-447a-978b-348c641f28f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:02.868867 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4eae6-f28a-447a-978b-348c641f28f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:02.870257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4eae6-f28a-447a-978b-348c641f28f9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:02.882142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 195/384] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:02.883277 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f37e1-3be5-42b5-9a32-4c882d835b4b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.883546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f37e1-3be5-42b5-9a32-4c882d835b4b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.883812 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f37e1-3be5-42b5-9a32-4c882d835b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.900867 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-759f37e1-3be5-42b5-9a32-4c882d835b4b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:02.902055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-759f37e1-3be5-42b5-9a32-4c882d835b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:02.962056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7b9c6-694d-4cfa-a1ce-02f420b74167 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:02.967812 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 196/385] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:02.968752 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f37e1-3be5-42b5-9a32-4c882d835b4b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:02.996033 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58091641-d300-45b2-80f1-b83efe2a3d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:02.996684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58091641-d300-45b2-80f1-b83efe2a3d2c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:02.996973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58091641-d300-45b2-80f1-b83efe2a3d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:02.997288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58091641-d300-45b2-80f1-b83efe2a3d2c None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:02.998390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58091641-d300-45b2-80f1-b83efe2a3d2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:02.998705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58091641-d300-45b2-80f1-b83efe2a3d2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.000157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58091641-d300-45b2-80f1-b83efe2a3d2c None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.041443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 190/386] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Oct 24 13:00:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:03.041443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58091641-d300-45b2-80f1-b83efe2a3d2c None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.043966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.086170 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f37e1-3be5-42b5-9a32-4c882d835b4b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.101937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.120045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e89a2-19f2-4a5e-802b-75db540cd804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.120920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e89a2-19f2-4a5e-802b-75db540cd804 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.121200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e89a2-19f2-4a5e-802b-75db540cd804 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.121472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e89a2-19f2-4a5e-802b-75db540cd804 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.132390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e89a2-19f2-4a5e-802b-75db540cd804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-8f9e89a2-19f2-4a5e-802b-75db540cd804 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:03.137291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:03.138156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 197/387] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:03.139798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e89a2-19f2-4a5e-802b-75db540cd804 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.155242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58091641-d300-45b2-80f1-b83efe2a3d2c None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.189932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a13708-914d-44fd-bc22-e07a6c2e531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.190752 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a13708-914d-44fd-bc22-e07a6c2e531b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.190998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a13708-914d-44fd-bc22-e07a6c2e531b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.191382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a13708-914d-44fd-bc22-e07a6c2e531b None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.192212 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a13708-914d-44fd-bc22-e07a6c2e531b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:03.192516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a13708-914d-44fd-bc22-e07a6c2e531b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.194005 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a13708-914d-44fd-bc22-e07a6c2e531b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.217859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 191/388] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:03.217859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a13708-914d-44fd-bc22-e07a6c2e531b None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.250473 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e89a2-19f2-4a5e-802b-75db540cd804 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.266966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.283559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad5f8e-8251-417e-8541-7f47ed5576b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.284173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5f8e-8251-417e-8541-7f47ed5576b5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.284485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5f8e-8251-417e-8541-7f47ed5576b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.284745 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5f8e-8251-417e-8541-7f47ed5576b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.291960 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad5f8e-8251-417e-8541-7f47ed5576b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.293484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad5f8e-8251-417e-8541-7f47ed5576b5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-10ad5f8e-8251-417e-8541-7f47ed5576b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:03.305893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:03.306886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 198/389] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:03.307773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad5f8e-8251-417e-8541-7f47ed5576b5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.318179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a13708-914d-44fd-bc22-e07a6c2e531b None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.332851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.354135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf63e0-aaca-4d79-a96f-f42cba4de4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.354783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf63e0-aaca-4d79-a96f-f42cba4de4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.355056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf63e0-aaca-4d79-a96f-f42cba4de4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.355322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf63e0-aaca-4d79-a96f-f42cba4de4a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.365658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf63e0-aaca-4d79-a96f-f42cba4de4a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.367118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf63e0-aaca-4d79-a96f-f42cba4de4a5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-cfbf63e0-aaca-4d79-a96f-f42cba4de4a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:03.381584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:03.382489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:03.383319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:03.383319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:03.383319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:03.383319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 192/390] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:03.383555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf63e0-aaca-4d79-a96f-f42cba4de4a5 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.409094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad5f8e-8251-417e-8541-7f47ed5576b5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.441731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8cf62-d16c-47bf-92ac-9502b324e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.442341 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8cf62-d16c-47bf-92ac-9502b324e1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.442609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8cf62-d16c-47bf-92ac-9502b324e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.442883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8cf62-d16c-47bf-92ac-9502b324e1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.443545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8cf62-d16c-47bf-92ac-9502b324e1d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:03.443843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8cf62-d16c-47bf-92ac-9502b324e1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.445260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8cf62-d16c-47bf-92ac-9502b324e1d3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.453019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 199/391] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:03.453934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8cf62-d16c-47bf-92ac-9502b324e1d3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.488419 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf63e0-aaca-4d79-a96f-f42cba4de4a5 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.495470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.521038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240a420-e8be-4439-b57d-8025fdb24de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.521674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240a420-e8be-4439-b57d-8025fdb24de1 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.521945 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240a420-e8be-4439-b57d-8025fdb24de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.522214 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240a420-e8be-4439-b57d-8025fdb24de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.533016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240a420-e8be-4439-b57d-8025fdb24de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.534477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240a420-e8be-4439-b57d-8025fdb24de1 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-7240a420-e8be-4439-b57d-8025fdb24de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:03.548728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:03.549648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:03.550546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:03.550546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:03.550546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:03.550546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 193/392] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:03.551043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240a420-e8be-4439-b57d-8025fdb24de1 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.560705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8cf62-d16c-47bf-92ac-9502b324e1d3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.569026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.593896 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001dbb8-5bcf-4dc4-9191-6390128b904d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.594521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001dbb8-5bcf-4dc4-9191-6390128b904d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.594792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001dbb8-5bcf-4dc4-9191-6390128b904d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.595062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001dbb8-5bcf-4dc4-9191-6390128b904d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.605735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001dbb8-5bcf-4dc4-9191-6390128b904d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.607285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001dbb8-5bcf-4dc4-9191-6390128b904d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-7001dbb8-5bcf-4dc4-9191-6390128b904d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:03.621326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:03.622378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:03.623586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:03.623586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:03.623586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:03.623586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 200/393] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:03.624003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001dbb8-5bcf-4dc4-9191-6390128b904d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.651916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240a420-e8be-4439-b57d-8025fdb24de1 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.684604 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde679c-caa8-4f12-a833-9ba242c1a2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.685211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde679c-caa8-4f12-a833-9ba242c1a2aa None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.685485 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde679c-caa8-4f12-a833-9ba242c1a2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.685753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde679c-caa8-4f12-a833-9ba242c1a2aa None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.686476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde679c-caa8-4f12-a833-9ba242c1a2aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:03.686776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde679c-caa8-4f12-a833-9ba242c1a2aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.688228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde679c-caa8-4f12-a833-9ba242c1a2aa None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.705545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 194/394] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:03.706330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde679c-caa8-4f12-a833-9ba242c1a2aa None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.716958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.726464 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001dbb8-5bcf-4dc4-9191-6390128b904d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.759544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72017a-13b2-49ae-a430-3ba5c0501379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.760100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72017a-13b2-49ae-a430-3ba5c0501379 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.760391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72017a-13b2-49ae-a430-3ba5c0501379 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.760666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72017a-13b2-49ae-a430-3ba5c0501379 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.761305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72017a-13b2-49ae-a430-3ba5c0501379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:03.761603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72017a-13b2-49ae-a430-3ba5c0501379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.762965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72017a-13b2-49ae-a430-3ba5c0501379 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.774485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 201/395] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:03.775224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72017a-13b2-49ae-a430-3ba5c0501379 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.779888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.805867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde679c-caa8-4f12-a833-9ba242c1a2aa None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.842758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25c097-d781-4306-8e48-361363996b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.842758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c097-d781-4306-8e48-361363996b09 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.842758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c097-d781-4306-8e48-361363996b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.842758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c097-d781-4306-8e48-361363996b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.853445 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25c097-d781-4306-8e48-361363996b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.853604 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25c097-d781-4306-8e48-361363996b09 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-7c25c097-d781-4306-8e48-361363996b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:03.868999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:03.869883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:03.870790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:03.870790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:03.870790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:03.870790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 195/396] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:03.871011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25c097-d781-4306-8e48-361363996b09 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.874792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72017a-13b2-49ae-a430-3ba5c0501379 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.908677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd423-1f15-4424-b006-b80fcee7156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:03.909289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd423-1f15-4424-b006-b80fcee7156b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:03.909551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd423-1f15-4424-b006-b80fcee7156b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:03.909816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd423-1f15-4424-b006-b80fcee7156b None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:03.910477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dd423-1f15-4424-b006-b80fcee7156b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:03.910772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dd423-1f15-4424-b006-b80fcee7156b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:03.912153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dd423-1f15-4424-b006-b80fcee7156b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:03.923183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 202/397] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:03.923936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd423-1f15-4424-b006-b80fcee7156b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:03.937961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:03.974344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25c097-d781-4306-8e48-361363996b09 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:03.999204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.009371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd322bd-ecfe-4b58-b8d5-3f2d1c5d6f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.010453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd322bd-ecfe-4b58-b8d5-3f2d1c5d6f80 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.010683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd322bd-ecfe-4b58-b8d5-3f2d1c5d6f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.010956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd322bd-ecfe-4b58-b8d5-3f2d1c5d6f80 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.011766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd322bd-ecfe-4b58-b8d5-3f2d1c5d6f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:04.012072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd322bd-ecfe-4b58-b8d5-3f2d1c5d6f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.013522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd322bd-ecfe-4b58-b8d5-3f2d1c5d6f80 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.024236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd423-1f15-4424-b006-b80fcee7156b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.025157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 196/398] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.025783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd322bd-ecfe-4b58-b8d5-3f2d1c5d6f80 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.062384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a2739-d330-451a-a39f-4134344f424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.063021 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a2739-d330-451a-a39f-4134344f424e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.063270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a2739-d330-451a-a39f-4134344f424e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.063606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a2739-d330-451a-a39f-4134344f424e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.075634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a2739-d330-451a-a39f-4134344f424e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.077125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a2739-d330-451a-a39f-4134344f424e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-879a2739-d330-451a-a39f-4134344f424e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:04.091568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:04.092647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:04.093581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:04.093581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:04.093581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:04.093581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 203/399] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:04.093581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a2739-d330-451a-a39f-4134344f424e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.135761 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd322bd-ecfe-4b58-b8d5-3f2d1c5d6f80 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.156667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.169984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3084983-172e-4b75-bddd-dc43d7eec710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.170608 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084983-172e-4b75-bddd-dc43d7eec710 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.170885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084983-172e-4b75-bddd-dc43d7eec710 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.171163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084983-172e-4b75-bddd-dc43d7eec710 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.177674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3084983-172e-4b75-bddd-dc43d7eec710 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.179119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3084983-172e-4b75-bddd-dc43d7eec710 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-a3084983-172e-4b75-bddd-dc43d7eec710 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:04.190875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:04.191950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:04.193112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:04.193112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:04.193112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:04.193112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:04.193112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:04.193112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:04.193112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:04.193112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:04.193112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 197/400] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:04.193756 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3084983-172e-4b75-bddd-dc43d7eec710 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.199899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a2739-d330-451a-a39f-4134344f424e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.232981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1fbb2-726a-4990-9468-561890294807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.233585 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fbb2-726a-4990-9468-561890294807 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.233859 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fbb2-726a-4990-9468-561890294807 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.234126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fbb2-726a-4990-9468-561890294807 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.234759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1fbb2-726a-4990-9468-561890294807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:04.235056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1fbb2-726a-4990-9468-561890294807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.236470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1fbb2-726a-4990-9468-561890294807 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.239759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.248373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 204/401] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.249176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1fbb2-726a-4990-9468-561890294807 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.290976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3084983-172e-4b75-bddd-dc43d7eec710 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.324535 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0020f37-55bb-4877-8c53-22a41468d7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.325166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0020f37-55bb-4877-8c53-22a41468d7ec None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.325442 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0020f37-55bb-4877-8c53-22a41468d7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.325708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0020f37-55bb-4877-8c53-22a41468d7ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.332980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0020f37-55bb-4877-8c53-22a41468d7ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.334421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0020f37-55bb-4877-8c53-22a41468d7ec None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.344242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1fbb2-726a-4990-9468-561890294807 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-c0020f37-55bb-4877-8c53-22a41468d7ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:04.345475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:04.346439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:04.347463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:04.347463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:04.347463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:04.347463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:04.347463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:04.347463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:04.347463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:04.347463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:04.347463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 198/402] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:04.347463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0020f37-55bb-4877-8c53-22a41468d7ec None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.370020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.382026 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be9760-6a4e-4374-b6eb-dc21d290dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.382641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be9760-6a4e-4374-b6eb-dc21d290dda7 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.382918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be9760-6a4e-4374-b6eb-dc21d290dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.383187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be9760-6a4e-4374-b6eb-dc21d290dda7 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.383813 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be9760-6a4e-4374-b6eb-dc21d290dda7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.385268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be9760-6a4e-4374-b6eb-dc21d290dda7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.405767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 205/403] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:04 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:04.406876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be9760-6a4e-4374-b6eb-dc21d290dda7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.465897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0020f37-55bb-4877-8c53-22a41468d7ec None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.474607 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.509708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097421cc-3670-4fc9-91dd-b29b9e8a8814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.510514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097421cc-3670-4fc9-91dd-b29b9e8a8814 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.510912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097421cc-3670-4fc9-91dd-b29b9e8a8814 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.511291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097421cc-3670-4fc9-91dd-b29b9e8a8814 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.512055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097421cc-3670-4fc9-91dd-b29b9e8a8814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:04.512505 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097421cc-3670-4fc9-91dd-b29b9e8a8814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.513939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097421cc-3670-4fc9-91dd-b29b9e8a8814 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.531721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 199/404] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.531953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be9760-6a4e-4374-b6eb-dc21d290dda7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.532046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097421cc-3670-4fc9-91dd-b29b9e8a8814 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.568338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627695-94f7-4603-b778-7c551750d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.569006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627695-94f7-4603-b778-7c551750d458 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.569350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627695-94f7-4603-b778-7c551750d458 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.569698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627695-94f7-4603-b778-7c551750d458 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.570470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627695-94f7-4603-b778-7c551750d458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:04.570846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627695-94f7-4603-b778-7c551750d458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.572407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627695-94f7-4603-b778-7c551750d458 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.591183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 206/405] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.593125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627695-94f7-4603-b778-7c551750d458 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.638225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.651205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097421cc-3670-4fc9-91dd-b29b9e8a8814 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.690834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80987b-4def-487c-9c26-10692f5e5b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.691531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80987b-4def-487c-9c26-10692f5e5b38 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.691816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80987b-4def-487c-9c26-10692f5e5b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.692086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80987b-4def-487c-9c26-10692f5e5b38 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.699333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80987b-4def-487c-9c26-10692f5e5b38 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.700894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80987b-4def-487c-9c26-10692f5e5b38 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.701889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627695-94f7-4603-b778-7c551750d458 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-7a80987b-4def-487c-9c26-10692f5e5b38 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:04.713244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:04.714330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:04.715233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 200/406] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:04.715777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80987b-4def-487c-9c26-10692f5e5b38 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.743539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.744684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0c2f-8c38-48ce-8352-4252c9247cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.745820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0c2f-8c38-48ce-8352-4252c9247cfa None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.746057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0c2f-8c38-48ce-8352-4252c9247cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.746334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0c2f-8c38-48ce-8352-4252c9247cfa None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.747073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0c2f-8c38-48ce-8352-4252c9247cfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:04.747412 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0c2f-8c38-48ce-8352-4252c9247cfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.749360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0c2f-8c38-48ce-8352-4252c9247cfa None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.761258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 207/407] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:04.762051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0c2f-8c38-48ce-8352-4252c9247cfa None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.831326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80987b-4def-487c-9c26-10692f5e5b38 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.868245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2d0e-1e5b-40b1-bf63-574a1a2b46b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.868918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2d0e-1e5b-40b1-bf63-574a1a2b46b3 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.869198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2d0e-1e5b-40b1-bf63-574a1a2b46b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.869473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2d0e-1e5b-40b1-bf63-574a1a2b46b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.871421 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:04.877971 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2d0e-1e5b-40b1-bf63-574a1a2b46b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.878124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0c2f-8c38-48ce-8352-4252c9247cfa None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:04.879708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2d0e-1e5b-40b1-bf63-574a1a2b46b3 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-c82a2d0e-1e5b-40b1-bf63-574a1a2b46b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:04.893486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:04.894387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:04.895292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:04.895292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:04.895292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:04.895292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:04.895292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:04.895292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:04.895292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:04.895292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:04.897498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 201/408] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:04.898539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2d0e-1e5b-40b1-bf63-574a1a2b46b3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:04.918778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaaba7-3cc5-422d-8fe0-5440e71c44b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:04.919446 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaaba7-3cc5-422d-8fe0-5440e71c44b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:04.919778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaaba7-3cc5-422d-8fe0-5440e71c44b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:04.920051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaaba7-3cc5-422d-8fe0-5440e71c44b4 None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/a47768a5f86d4c6292099691f6cab1e6/roles/44dc9e93541449b6b5f221c79be8b938` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:04.935099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaaba7-3cc5-422d-8fe0-5440e71c44b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=a47768a5f86d4c6292099691f6cab1e6, role_id=44dc9e93541449b6b5f221c79be8b938)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:04.936727 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaaba7-3cc5-422d-8fe0-5440e71c44b4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:04.960321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 208/409] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:04 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/a47768a5f86d4c6292099691f6cab1e6/roles/44dc9e93541449b6b5f221c79be8b938 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:04.960321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaaba7-3cc5-422d-8fe0-5440e71c44b4 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.009993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.028768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2d0e-1e5b-40b1-bf63-574a1a2b46b3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.074335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf079c-5e1f-46c1-ae98-f81de7b78c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.075290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf079c-5e1f-46c1-ae98-f81de7b78c83 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.075642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf079c-5e1f-46c1-ae98-f81de7b78c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.075980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf079c-5e1f-46c1-ae98-f81de7b78c83 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.076832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf079c-5e1f-46c1-ae98-f81de7b78c83 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:05.077798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf079c-5e1f-46c1-ae98-f81de7b78c83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.079771 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf079c-5e1f-46c1-ae98-f81de7b78c83 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.093229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaaba7-3cc5-422d-8fe0-5440e71c44b4 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.105541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 202/410] 10.222.0.15 () {56 vars in 1139 bytes} [Mon Oct 24 13:00:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:05.106255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf079c-5e1f-46c1-ae98-f81de7b78c83 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.146490 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75992af-6000-4c49-92b6-6db44ee09a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.148626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75992af-6000-4c49-92b6-6db44ee09a34 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.149208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75992af-6000-4c49-92b6-6db44ee09a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.149677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75992af-6000-4c49-92b6-6db44ee09a34 None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/c9b6f4afedfc4d45995b8a671e2d01e8/roles/44dc9e93541449b6b5f221c79be8b938` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.168722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75992af-6000-4c49-92b6-6db44ee09a34 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=c9b6f4afedfc4d45995b8a671e2d01e8, role_id=44dc9e93541449b6b5f221c79be8b938)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.170445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75992af-6000-4c49-92b6-6db44ee09a34 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.183683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.187762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 209/411] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:04 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/c9b6f4afedfc4d45995b8a671e2d01e8/roles/44dc9e93541449b6b5f221c79be8b938 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:05.196426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75992af-6000-4c49-92b6-6db44ee09a34 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.231496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf079c-5e1f-46c1-ae98-f81de7b78c83 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.292632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a3309-5929-4918-8453-d91a35f284cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.293306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a3309-5929-4918-8453-d91a35f284cc None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.293587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a3309-5929-4918-8453-d91a35f284cc None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.293854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a3309-5929-4918-8453-d91a35f284cc None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.294644 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a3309-5929-4918-8453-d91a35f284cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:05.294951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a3309-5929-4918-8453-d91a35f284cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.301279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a3309-5929-4918-8453-d91a35f284cc None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.337685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 203/412] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:05.345124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a3309-5929-4918-8453-d91a35f284cc None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.350372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75992af-6000-4c49-92b6-6db44ee09a34 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.357194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.429932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfdc05-9cde-45c9-9a49-69ae55f282e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.430594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfdc05-9cde-45c9-9a49-69ae55f282e1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.430911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfdc05-9cde-45c9-9a49-69ae55f282e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.431196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfdc05-9cde-45c9-9a49-69ae55f282e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.443691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfdc05-9cde-45c9-9a49-69ae55f282e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.445053 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfdc05-9cde-45c9-9a49-69ae55f282e1 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-62cfdc05-9cde-45c9-9a49-69ae55f282e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:05.466197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:05.467149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:05.468006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:05.468006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:05.468006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:05.470258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 210/413] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:05.474625 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfdc05-9cde-45c9-9a49-69ae55f282e1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.500339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a3309-5929-4918-8453-d91a35f284cc None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.539797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.545060 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0fd7b-e4ae-4aaf-9988-b276e3cef939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.546709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0fd7b-e4ae-4aaf-9988-b276e3cef939 None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.547787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0fd7b-e4ae-4aaf-9988-b276e3cef939 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.548481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0fd7b-e4ae-4aaf-9988-b276e3cef939 None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/d66e6f6ea62d439c87d9551286d29615/roles/44dc9e93541449b6b5f221c79be8b938` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.579525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0fd7b-e4ae-4aaf-9988-b276e3cef939 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=d66e6f6ea62d439c87d9551286d29615, role_id=44dc9e93541449b6b5f221c79be8b938)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.581168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0fd7b-e4ae-4aaf-9988-b276e3cef939 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.606312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 204/414] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:05 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/d66e6f6ea62d439c87d9551286d29615/roles/44dc9e93541449b6b5f221c79be8b938 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:00:05.618732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfdc05-9cde-45c9-9a49-69ae55f282e1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.672800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f7e41-110a-477e-853f-7015703b0d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.674114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f7e41-110a-477e-853f-7015703b0d99 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.674829 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f7e41-110a-477e-853f-7015703b0d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.675959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f7e41-110a-477e-853f-7015703b0d99 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.678898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f7e41-110a-477e-853f-7015703b0d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:05.679543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f7e41-110a-477e-853f-7015703b0d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.681303 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f7e41-110a-477e-853f-7015703b0d99 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.701456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 211/415] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:05.709474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0fd7b-e4ae-4aaf-9988-b276e3cef939 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:05.788935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:05.845499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0fd7b-e4ae-4aaf-9988-b276e3cef939 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:05.889566 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfef963-779a-420a-a3fe-f6e7259232a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:05.890139 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef963-779a-420a-a3fe-f6e7259232a1 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:05.890465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef963-779a-420a-a3fe-f6e7259232a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:05.890744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef963-779a-420a-a3fe-f6e7259232a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:05.897667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfef963-779a-420a-a3fe-f6e7259232a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:05.899130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfef963-779a-420a-a3fe-f6e7259232a1 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-5cfef963-779a-420a-a3fe-f6e7259232a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:05.910625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:05.911480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:05.912351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:05.912351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:05.912351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:05.912351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:05.912351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:05.912351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:05.912351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:05.912351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:05.912351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 205/416] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:05.917780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f7e41-110a-477e-853f-7015703b0d99 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:06.034212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f7e41-110a-477e-853f-7015703b0d99 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.048364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:06.081907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a5fc7-075c-4ee4-b816-e68a6e538c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.082608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5fc7-075c-4ee4-b816-e68a6e538c23 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.082886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5fc7-075c-4ee4-b816-e68a6e538c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.083156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5fc7-075c-4ee4-b816-e68a6e538c23 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.083856 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a5fc7-075c-4ee4-b816-e68a6e538c23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:06.084158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a5fc7-075c-4ee4-b816-e68a6e538c23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.085645 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a5fc7-075c-4ee4-b816-e68a6e538c23 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.102686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 212/417] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:06.104117 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfef963-779a-420a-a3fe-f6e7259232a1 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:06.236233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfef963-779a-420a-a3fe-f6e7259232a1 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:06.257232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:06.289091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e0a1e-f65e-487a-ad67-d65a10eac941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:06.289795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0a1e-f65e-487a-ad67-d65a10eac941 None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.290080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0a1e-f65e-487a-ad67-d65a10eac941 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.290369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0a1e-f65e-487a-ad67-d65a10eac941 None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/974f2acdadf14df69cbe33351ee02a17/roles/44dc9e93541449b6b5f221c79be8b938` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.306866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e0a1e-f65e-487a-ad67-d65a10eac941 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=974f2acdadf14df69cbe33351ee02a17, role_id=44dc9e93541449b6b5f221c79be8b938)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:06.308347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e0a1e-f65e-487a-ad67-d65a10eac941 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:06.335651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 206/418] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:06 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/974f2acdadf14df69cbe33351ee02a17/roles/44dc9e93541449b6b5f221c79be8b938 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:06.872781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871dc7e-28c1-47b1-b0c5-eea6f531a568 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.873469 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871dc7e-28c1-47b1-b0c5-eea6f531a568 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.873708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871dc7e-28c1-47b1-b0c5-eea6f531a568 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.875341 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 213/419] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:06.880955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55dcbb-1a39-41a0-976c-34907438084c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:06.881245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55dcbb-1a39-41a0-976c-34907438084c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:06.881526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55dcbb-1a39-41a0-976c-34907438084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:06.900187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-bc55dcbb-1a39-41a0-976c-34907438084c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:06.901481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bc55dcbb-1a39-41a0-976c-34907438084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:06.974832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 207/420] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:07.355729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871dc7e-28c1-47b1-b0c5-eea6f531a568 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:07.495346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871dc7e-28c1-47b1-b0c5-eea6f531a568 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:07.522259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3d610-2689-423e-95f8-7c72e6833c8c None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:07.522777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3d610-2689-423e-95f8-7c72e6833c8c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:07.522851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3d610-2689-423e-95f8-7c72e6833c8c None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:07.524797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 208/421] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:07.529642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b84e5-61f4-4c70-b3ef-8a47dfb19660 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:07.529925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b84e5-61f4-4c70-b3ef-8a47dfb19660 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:07.530198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b84e5-61f4-4c70-b3ef-8a47dfb19660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:07.546705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fea2b-6a7f-4a33-9bf7-c182b1496b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:07.547652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fea2b-6a7f-4a33-9bf7-c182b1496b05 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:07.548107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fea2b-6a7f-4a33-9bf7-c182b1496b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:07.548579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fea2b-6a7f-4a33-9bf7-c182b1496b05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:07.561351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-504b84e5-61f4-4c70-b3ef-8a47dfb19660 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:07.564713 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-504b84e5-61f4-4c70-b3ef-8a47dfb19660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:07.570489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fea2b-6a7f-4a33-9bf7-c182b1496b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b20fea2b-6a7f-4a33-9bf7-c182b1496b05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:07.578292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:07.579180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:07.579988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 214/422] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:07.589076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fea2b-6a7f-4a33-9bf7-c182b1496b05 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:07.650662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 209/423] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:07.672674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:07.744520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fea2b-6a7f-4a33-9bf7-c182b1496b05 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:07.780024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc15914-3647-47b0-9c24-e98a58bfb9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:07.780679 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc15914-3647-47b0-9c24-e98a58bfb9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:07.780954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc15914-3647-47b0-9c24-e98a58bfb9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:07.781228 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc15914-3647-47b0-9c24-e98a58bfb9a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:07.781908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc15914-3647-47b0-9c24-e98a58bfb9a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:07.782258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc15914-3647-47b0-9c24-e98a58bfb9a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:07.783794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc15914-3647-47b0-9c24-e98a58bfb9a0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:07.793306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 215/424] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:07.799002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b84e5-61f4-4c70-b3ef-8a47dfb19660 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:07.824810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:07.913559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b84e5-61f4-4c70-b3ef-8a47dfb19660 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:07.947935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b74d0-bb61-4385-8065-bfaa8f09513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:07.948599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b74d0-bb61-4385-8065-bfaa8f09513d None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:07.948928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b74d0-bb61-4385-8065-bfaa8f09513d None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:07.949251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b74d0-bb61-4385-8065-bfaa8f09513d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:07.959381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b74d0-bb61-4385-8065-bfaa8f09513d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:07.960877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b74d0-bb61-4385-8065-bfaa8f09513d None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:07.974938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb722-41d0-4ce3-9f95-ee87a956d59e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:07.975246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb722-41d0-4ce3-9f95-ee87a956d59e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:07.975484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb722-41d0-4ce3-9f95-ee87a956d59e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:07.977032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 216/425] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-8b2b74d0-bb61-4385-8065-bfaa8f09513d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:07.979611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:07.980520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:07.981769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:07.981769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:07.981769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:07.981769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 210/426] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:07.986510 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb722-41d0-4ce3-9f95-ee87a956d59e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:07.998727 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728773e-057e-40c0-b2a8-3c621b38aa53 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:07.999027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728773e-057e-40c0-b2a8-3c621b38aa53 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:07.999358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728773e-057e-40c0-b2a8-3c621b38aa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.033402 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d728773e-057e-40c0-b2a8-3c621b38aa53 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:08.034609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d728773e-057e-40c0-b2a8-3c621b38aa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:08.121606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:08.132448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb722-41d0-4ce3-9f95-ee87a956d59e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:08.154626 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 211/427] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:08.155496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728773e-057e-40c0-b2a8-3c621b38aa53 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:08.187487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:08.194549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989439-262f-4830-9052-a47b8f7442b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:08.195121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989439-262f-4830-9052-a47b8f7442b8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.195401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989439-262f-4830-9052-a47b8f7442b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.195674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989439-262f-4830-9052-a47b8f7442b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.197316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7989439-262f-4830-9052-a47b8f7442b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:08.197620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7989439-262f-4830-9052-a47b8f7442b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:08.199807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7989439-262f-4830-9052-a47b8f7442b8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:08.225418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 217/428] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:08.229905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989439-262f-4830-9052-a47b8f7442b8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:08.368105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728773e-057e-40c0-b2a8-3c621b38aa53 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:08.427269 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989439-262f-4830-9052-a47b8f7442b8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:08.430540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557361b6-14b5-479f-bd73-4762c2e43044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:08.431425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557361b6-14b5-479f-bd73-4762c2e43044 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.431915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557361b6-14b5-479f-bd73-4762c2e43044 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.432404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557361b6-14b5-479f-bd73-4762c2e43044 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.444806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557361b6-14b5-479f-bd73-4762c2e43044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-557361b6-14b5-479f-bd73-4762c2e43044 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:08.449849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:08.450718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:08.451495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 212/429] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:08.452647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1d028-db53-42fc-b526-07f700baf385 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.452739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1d028-db53-42fc-b526-07f700baf385 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.453002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1d028-db53-42fc-b526-07f700baf385 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.456395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 213/430] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:08.459265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1d028-db53-42fc-b526-07f700baf385 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:08.478322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08669025-87a7-4fec-ac02-651410ac051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:08.478964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669025-87a7-4fec-ac02-651410ac051d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.479239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669025-87a7-4fec-ac02-651410ac051d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.480001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669025-87a7-4fec-ac02-651410ac051d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.490051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08669025-87a7-4fec-ac02-651410ac051d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:08.491860 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08669025-87a7-4fec-ac02-651410ac051d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-08669025-87a7-4fec-ac02-651410ac051d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:08.505634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:08.506606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:08.507509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 218/431] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:08.508704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420359-4ac9-4677-a9af-155478c76919 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.508704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420359-4ac9-4677-a9af-155478c76919 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.508850 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420359-4ac9-4677-a9af-155478c76919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.526770 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-bf420359-4ac9-4677-a9af-155478c76919 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:08.527974 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bf420359-4ac9-4677-a9af-155478c76919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:08.538225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:08.538852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:08.578033 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1d028-db53-42fc-b526-07f700baf385 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:08.604466 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 219/432] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:08.604466 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf420359-4ac9-4677-a9af-155478c76919 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:08.624453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cbabb-4156-42f8-8d36-370db50cf921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:08.625221 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cbabb-4156-42f8-8d36-370db50cf921 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.625600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cbabb-4156-42f8-8d36-370db50cf921 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.625938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cbabb-4156-42f8-8d36-370db50cf921 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.626726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cbabb-4156-42f8-8d36-370db50cf921 None admin] RBAC: Adding query filter params (name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:08.627086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cbabb-4156-42f8-8d36-370db50cf921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:08.629513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cbabb-4156-42f8-8d36-370db50cf921 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:08.644599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 214/433] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:08.644599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cbabb-4156-42f8-8d36-370db50cf921 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:08.718836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf420359-4ac9-4677-a9af-155478c76919 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:08.755830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adde1d1-3c11-431f-ace3-3484c5c23e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:08.756740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde1d1-3c11-431f-ace3-3484c5c23e6f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.757019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde1d1-3c11-431f-ace3-3484c5c23e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.757286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde1d1-3c11-431f-ace3-3484c5c23e6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.759107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cbabb-4156-42f8-8d36-370db50cf921 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:08.767677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adde1d1-3c11-431f-ace3-3484c5c23e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-7adde1d1-3c11-431f-ace3-3484c5c23e6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:08.772761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:08.773646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:08.774445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:08.778825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 220/434] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:08.779663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adde1d1-3c11-431f-ace3-3484c5c23e6f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:08.783822 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:08.791317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:08.801313 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaec57-d894-4843-921e-8b5fd0e1faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:08.802205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaec57-d894-4843-921e-8b5fd0e1faaf None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.802684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaec57-d894-4843-921e-8b5fd0e1faaf None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.803148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaec57-d894-4843-921e-8b5fd0e1faaf None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.804077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaec57-d894-4843-921e-8b5fd0e1faaf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:08.804624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaec57-d894-4843-921e-8b5fd0e1faaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:08.806262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaec57-d894-4843-921e-8b5fd0e1faaf None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:08.825969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 215/435] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Oct 24 13:00:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:08.827216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaec57-d894-4843-921e-8b5fd0e1faaf None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:08.893843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adde1d1-3c11-431f-ace3-3484c5c23e6f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:08.928706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950509db-b15b-4d15-854e-51d79be178fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:08.929340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950509db-b15b-4d15-854e-51d79be178fd None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.929613 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950509db-b15b-4d15-854e-51d79be178fd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.929880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950509db-b15b-4d15-854e-51d79be178fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.940132 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950509db-b15b-4d15-854e-51d79be178fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:08.941657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950509db-b15b-4d15-854e-51d79be178fd None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:08.948140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaec57-d894-4843-921e-8b5fd0e1faaf None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-950509db-b15b-4d15-854e-51d79be178fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:08.956746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:08.957764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:08.958652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:08.958652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:08.958652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:08.960588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 221/436] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:08.962056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950509db-b15b-4d15-854e-51d79be178fd None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:08.990650 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415bec1-ee9f-4581-8c2a-ea4e49b4ad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:08.991239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415bec1-ee9f-4581-8c2a-ea4e49b4ad0b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:08.991527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415bec1-ee9f-4581-8c2a-ea4e49b4ad0b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:08.991790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415bec1-ee9f-4581-8c2a-ea4e49b4ad0b None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:08.992488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415bec1-ee9f-4581-8c2a-ea4e49b4ad0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:08.992793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415bec1-ee9f-4581-8c2a-ea4e49b4ad0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:08.994177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415bec1-ee9f-4581-8c2a-ea4e49b4ad0b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.002774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 216/437] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:09.003573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415bec1-ee9f-4581-8c2a-ea4e49b4ad0b None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.022171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.052115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.065119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950509db-b15b-4d15-854e-51d79be178fd None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.098144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f5cd9-2155-4f46-b7b6-148724a481fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.098880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f5cd9-2155-4f46-b7b6-148724a481fe None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.099160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f5cd9-2155-4f46-b7b6-148724a481fe None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.099436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f5cd9-2155-4f46-b7b6-148724a481fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.101260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415bec1-ee9f-4581-8c2a-ea4e49b4ad0b None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.110015 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f5cd9-2155-4f46-b7b6-148724a481fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.111508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f5cd9-2155-4f46-b7b6-148724a481fe None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-bf1f5cd9-2155-4f46-b7b6-148724a481fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:09.125526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:09.126563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:09.127566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:09.127566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:09.127566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:09.127566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 222/438] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:09.127566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f5cd9-2155-4f46-b7b6-148724a481fe None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.140980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4267f9-c524-4d5b-bfb4-c8d6ba4d4df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.141623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4267f9-c524-4d5b-bfb4-c8d6ba4d4df9 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.141906 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4267f9-c524-4d5b-bfb4-c8d6ba4d4df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.142185 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4267f9-c524-4d5b-bfb4-c8d6ba4d4df9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.152096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4267f9-c524-4d5b-bfb4-c8d6ba4d4df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-2a4267f9-c524-4d5b-bfb4-c8d6ba4d4df9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:09.157347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:09.158414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:09.159405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 217/439] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:09.160160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29c50b-3604-4b56-86fe-037d0cfbc3dc None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.160160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29c50b-3604-4b56-86fe-037d0cfbc3dc None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.160160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29c50b-3604-4b56-86fe-037d0cfbc3dc None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.164467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 218/440] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:09.164467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29c50b-3604-4b56-86fe-037d0cfbc3dc None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.234264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f5cd9-2155-4f46-b7b6-148724a481fe None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.243138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.263313 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29c50b-3604-4b56-86fe-037d0cfbc3dc None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.268315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93c800-db3a-4daf-a56d-f0d760659d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.268940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c800-db3a-4daf-a56d-f0d760659d08 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.269219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c800-db3a-4daf-a56d-f0d760659d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.269493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c800-db3a-4daf-a56d-f0d760659d08 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.270141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93c800-db3a-4daf-a56d-f0d760659d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:09.270444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93c800-db3a-4daf-a56d-f0d760659d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.271840 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93c800-db3a-4daf-a56d-f0d760659d08 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.271966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.287881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 223/441] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:09.287881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93c800-db3a-4daf-a56d-f0d760659d08 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.297124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9e16b-f979-4c5a-adb4-572a9f41c34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.297755 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e16b-f979-4c5a-adb4-572a9f41c34f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.298073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e16b-f979-4c5a-adb4-572a9f41c34f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.298344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e16b-f979-4c5a-adb4-572a9f41c34f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.308643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9e16b-f979-4c5a-adb4-572a9f41c34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.310138 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9e16b-f979-4c5a-adb4-572a9f41c34f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-0fd9e16b-f979-4c5a-adb4-572a9f41c34f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:09.323981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:09.325061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:09.325903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:09.325903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:09.325903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:09.325903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 219/442] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:09.326131 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9e16b-f979-4c5a-adb4-572a9f41c34f None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.384356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93c800-db3a-4daf-a56d-f0d760659d08 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.416513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac7db3-ffb9-4041-a6f7-3407fe911507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.417112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac7db3-ffb9-4041-a6f7-3407fe911507 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.417386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac7db3-ffb9-4041-a6f7-3407fe911507 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.417655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac7db3-ffb9-4041-a6f7-3407fe911507 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.418296 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac7db3-ffb9-4041-a6f7-3407fe911507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:09.418593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac7db3-ffb9-4041-a6f7-3407fe911507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.419987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac7db3-ffb9-4041-a6f7-3407fe911507 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.421283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9e16b-f979-4c5a-adb4-572a9f41c34f None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.430951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 224/443] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:09.431874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafff75d-b3c2-48a5-8454-acf555318a31 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.432151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafff75d-b3c2-48a5-8454-acf555318a31 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.432454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafff75d-b3c2-48a5-8454-acf555318a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.450255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-fafff75d-b3c2-48a5-8454-acf555318a31 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:09.451441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fafff75d-b3c2-48a5-8454-acf555318a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:09.454818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d5709-0ead-438b-8b92-6d598a5ecc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.455440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d5709-0ead-438b-8b92-6d598a5ecc10 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.455711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d5709-0ead-438b-8b92-6d598a5ecc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.455981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d5709-0ead-438b-8b92-6d598a5ecc10 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.456690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d5709-0ead-438b-8b92-6d598a5ecc10 None admin] RBAC: Adding query filter params (name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:09.457033 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d5709-0ead-438b-8b92-6d598a5ecc10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.458406 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d5709-0ead-438b-8b92-6d598a5ecc10 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.466108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 220/444] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:09.466887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d5709-0ead-438b-8b92-6d598a5ecc10 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.478178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.492713 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.522198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 225/445] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:09.522970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafff75d-b3c2-48a5-8454-acf555318a31 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.570152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d5709-0ead-438b-8b92-6d598a5ecc10 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.604550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5b5e4-d251-48ed-990b-7e5ba4b0e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.605182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b5e4-d251-48ed-990b-7e5ba4b0e576 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.605471 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b5e4-d251-48ed-990b-7e5ba4b0e576 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.605793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b5e4-d251-48ed-990b-7e5ba4b0e576 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.613329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5b5e4-d251-48ed-990b-7e5ba4b0e576 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.614781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5b5e4-d251-48ed-990b-7e5ba4b0e576 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.625377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafff75d-b3c2-48a5-8454-acf555318a31 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-99e5b5e4-d251-48ed-990b-7e5ba4b0e576 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:09.626572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:09.627443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:09.628358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 221/446] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:09.629028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5b5e4-d251-48ed-990b-7e5ba4b0e576 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.668872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c24e2d-f154-4b5d-8039-8020717462d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.669485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c24e2d-f154-4b5d-8039-8020717462d9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.669758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c24e2d-f154-4b5d-8039-8020717462d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.670038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c24e2d-f154-4b5d-8039-8020717462d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.670687 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c24e2d-f154-4b5d-8039-8020717462d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:09.670989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c24e2d-f154-4b5d-8039-8020717462d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.672400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c24e2d-f154-4b5d-8039-8020717462d9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.683611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 226/447] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:09.688869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c24e2d-f154-4b5d-8039-8020717462d9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.709743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.717843 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.738580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5b5e4-d251-48ed-990b-7e5ba4b0e576 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.775069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37496c20-7e2d-492a-9444-3bd0934544ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.775631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37496c20-7e2d-492a-9444-3bd0934544ef None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.775909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37496c20-7e2d-492a-9444-3bd0934544ef None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.776179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37496c20-7e2d-492a-9444-3bd0934544ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.782853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37496c20-7e2d-492a-9444-3bd0934544ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.784676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37496c20-7e2d-492a-9444-3bd0934544ef None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.792438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c24e2d-f154-4b5d-8039-8020717462d9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-37496c20-7e2d-492a-9444-3bd0934544ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:09.796179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:09.797220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:09.798277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:09.798277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:09.798277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:09.798277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:09.798277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:09.798277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:09.798277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:09.798277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:09.798277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 222/448] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:09.798277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37496c20-7e2d-492a-9444-3bd0934544ef None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.827647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baac8b-0c07-427d-9c0e-7f647dd9a580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.828272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baac8b-0c07-427d-9c0e-7f647dd9a580 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.828578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baac8b-0c07-427d-9c0e-7f647dd9a580 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.828850 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baac8b-0c07-427d-9c0e-7f647dd9a580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.838996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baac8b-0c07-427d-9c0e-7f647dd9a580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.842958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baac8b-0c07-427d-9c0e-7f647dd9a580 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-81baac8b-0c07-427d-9c0e-7f647dd9a580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:09.857588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:09.858535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:09.859387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:09.859387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:09.859387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:09.859387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 227/449] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:09.859597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baac8b-0c07-427d-9c0e-7f647dd9a580 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.897781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37496c20-7e2d-492a-9444-3bd0934544ef None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.928804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.930920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81da9b-ff82-4dfa-bed2-a4896cac3084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.931635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81da9b-ff82-4dfa-bed2-a4896cac3084 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.931929 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81da9b-ff82-4dfa-bed2-a4896cac3084 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.932426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81da9b-ff82-4dfa-bed2-a4896cac3084 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:09.933166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81da9b-ff82-4dfa-bed2-a4896cac3084 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:09.933468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81da9b-ff82-4dfa-bed2-a4896cac3084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:09.934894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81da9b-ff82-4dfa-bed2-a4896cac3084 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:09.948486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:09.952760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 223/450] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:09.953869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81da9b-ff82-4dfa-bed2-a4896cac3084 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:09.958657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baac8b-0c07-427d-9c0e-7f647dd9a580 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:09.991179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b3c85-887d-4cd8-b01a-c27b83dc59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:09.991827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b3c85-887d-4cd8-b01a-c27b83dc59be None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:09.992102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b3c85-887d-4cd8-b01a-c27b83dc59be None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:09.992388 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b3c85-887d-4cd8-b01a-c27b83dc59be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.000225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b3c85-887d-4cd8-b01a-c27b83dc59be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.001726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b3c85-887d-4cd8-b01a-c27b83dc59be None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-710b3c85-887d-4cd8-b01a-c27b83dc59be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:10.012854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:10.013788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 228/451] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:10.014708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b3c85-887d-4cd8-b01a-c27b83dc59be None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.056774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81da9b-ff82-4dfa-bed2-a4896cac3084 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.090347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de11a4-455a-4f27-97cf-f036bdba81ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.090984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de11a4-455a-4f27-97cf-f036bdba81ed None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.091235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de11a4-455a-4f27-97cf-f036bdba81ed None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.091536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de11a4-455a-4f27-97cf-f036bdba81ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.102285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de11a4-455a-4f27-97cf-f036bdba81ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-40de11a4-455a-4f27-97cf-f036bdba81ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:10.107070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:10.107948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:10.108953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 224/452] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:10.109655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de11a4-455a-4f27-97cf-f036bdba81ed None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.113804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b3c85-887d-4cd8-b01a-c27b83dc59be None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.141417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.147774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411ca60-0e7d-4232-9fb1-4f84f02cd02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.148410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411ca60-0e7d-4232-9fb1-4f84f02cd02b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.148691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411ca60-0e7d-4232-9fb1-4f84f02cd02b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.148969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411ca60-0e7d-4232-9fb1-4f84f02cd02b None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.149660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411ca60-0e7d-4232-9fb1-4f84f02cd02b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:10.149966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411ca60-0e7d-4232-9fb1-4f84f02cd02b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.151402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411ca60-0e7d-4232-9fb1-4f84f02cd02b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.163090 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 229/453] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:10.163866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411ca60-0e7d-4232-9fb1-4f84f02cd02b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.171966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.213707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de11a4-455a-4f27-97cf-f036bdba81ed None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.249265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51f8ac-1737-4e5a-882d-bf7938e3c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.249900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51f8ac-1737-4e5a-882d-bf7938e3c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.250169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51f8ac-1737-4e5a-882d-bf7938e3c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.250450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51f8ac-1737-4e5a-882d-bf7938e3c8b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.251088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51f8ac-1737-4e5a-882d-bf7938e3c8b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:10.251394 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51f8ac-1737-4e5a-882d-bf7938e3c8b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.252822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51f8ac-1737-4e5a-882d-bf7938e3c8b1 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.261287 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411ca60-0e7d-4232-9fb1-4f84f02cd02b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.264193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 225/454] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:10.265007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51f8ac-1737-4e5a-882d-bf7938e3c8b1 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.294724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12479-ff12-4d8d-b01d-bafb32b9f94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.295330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12479-ff12-4d8d-b01d-bafb32b9f94d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.295589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12479-ff12-4d8d-b01d-bafb32b9f94d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.295862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12479-ff12-4d8d-b01d-bafb32b9f94d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.350629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.361227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c12479-ff12-4d8d-b01d-bafb32b9f94d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.361698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51f8ac-1737-4e5a-882d-bf7938e3c8b1 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.362680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c12479-ff12-4d8d-b01d-bafb32b9f94d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.381611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.396642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03b747-854c-4ad2-8735-dfe76b6ac8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.397244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03b747-854c-4ad2-8735-dfe76b6ac8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.397519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03b747-854c-4ad2-8735-dfe76b6ac8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.397786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03b747-854c-4ad2-8735-dfe76b6ac8e3 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.398510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03b747-854c-4ad2-8735-dfe76b6ac8e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:10.398812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03b747-854c-4ad2-8735-dfe76b6ac8e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.400248 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03b747-854c-4ad2-8735-dfe76b6ac8e3 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.417257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 226/455] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:10.418052 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03b747-854c-4ad2-8735-dfe76b6ac8e3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.464601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 230/456] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:10.465436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12479-ff12-4d8d-b01d-bafb32b9f94d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.518799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03b747-854c-4ad2-8735-dfe76b6ac8e3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.553352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3046-aaa5-4713-a55a-fe992f5c00e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.553964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3046-aaa5-4713-a55a-fe992f5c00e7 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.554069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.554243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3046-aaa5-4713-a55a-fe992f5c00e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.554510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3046-aaa5-4713-a55a-fe992f5c00e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.555200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab3046-aaa5-4713-a55a-fe992f5c00e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:10.555663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab3046-aaa5-4713-a55a-fe992f5c00e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.557021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab3046-aaa5-4713-a55a-fe992f5c00e7 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.563901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12479-ff12-4d8d-b01d-bafb32b9f94d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.564762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 227/457] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:10.565376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3046-aaa5-4713-a55a-fe992f5c00e7 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.598171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd02b1-80ff-4487-b0fa-92bdff323e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.598824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd02b1-80ff-4487-b0fa-92bdff323e11 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.599132 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd02b1-80ff-4487-b0fa-92bdff323e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.599380 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd02b1-80ff-4487-b0fa-92bdff323e11 None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/2e1fbb5f8a384aac98e17bd622e25eec/roles/44dc9e93541449b6b5f221c79be8b938` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.609006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.613630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd02b1-80ff-4487-b0fa-92bdff323e11 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=2e1fbb5f8a384aac98e17bd622e25eec, role_id=44dc9e93541449b6b5f221c79be8b938)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.615061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd02b1-80ff-4487-b0fa-92bdff323e11 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.628346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 231/458] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:10 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/2e1fbb5f8a384aac98e17bd622e25eec/roles/44dc9e93541449b6b5f221c79be8b938 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:10.637988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd02b1-80ff-4487-b0fa-92bdff323e11 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.684199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3046-aaa5-4713-a55a-fe992f5c00e7 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.722234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cc367-83b5-4978-9202-e8ebdb16e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.723016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cc367-83b5-4978-9202-e8ebdb16e9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.723292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cc367-83b5-4978-9202-e8ebdb16e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.723562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cc367-83b5-4978-9202-e8ebdb16e9e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.732048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cc367-83b5-4978-9202-e8ebdb16e9e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.733592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cc367-83b5-4978-9202-e8ebdb16e9e8 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.742142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd02b1-80ff-4487-b0fa-92bdff323e11 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-0a8cc367-83b5-4978-9202-e8ebdb16e9e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:10.746086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:10.747019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 228/459] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:10.753360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cc367-83b5-4978-9202-e8ebdb16e9e8 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.783781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c02869-e1a0-4186-8556-f5d03937f52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.784554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c02869-e1a0-4186-8556-f5d03937f52c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.784889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c02869-e1a0-4186-8556-f5d03937f52c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.785233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c02869-e1a0-4186-8556-f5d03937f52c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.796706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.864137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:10.867205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cc367-83b5-4978-9202-e8ebdb16e9e8 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:10.877720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c02869-e1a0-4186-8556-f5d03937f52c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.879907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c02869-e1a0-4186-8556-f5d03937f52c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.901861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af185a-c01b-46bd-9bb5-d3d8251acf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:10.902583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af185a-c01b-46bd-9bb5-d3d8251acf31 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:10.902927 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af185a-c01b-46bd-9bb5-d3d8251acf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:10.903311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af185a-c01b-46bd-9bb5-d3d8251acf31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:10.914744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af185a-c01b-46bd-9bb5-d3d8251acf31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:10.916267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af185a-c01b-46bd-9bb5-d3d8251acf31 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-f0af185a-c01b-46bd-9bb5-d3d8251acf31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:10.931152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:10.932230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:10.937638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:10.937638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:10.937638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:10.937638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 229/460] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:10.937638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af185a-c01b-46bd-9bb5-d3d8251acf31 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:10.994783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 232/461] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:10.995886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c02869-e1a0-4186-8556-f5d03937f52c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.038887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af185a-c01b-46bd-9bb5-d3d8251acf31 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:11.042990 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:11.072573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34317-517e-439c-9168-99f9eaebe653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:11.073213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34317-517e-439c-9168-99f9eaebe653 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.073493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34317-517e-439c-9168-99f9eaebe653 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.073840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34317-517e-439c-9168-99f9eaebe653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.084388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c34317-517e-439c-9168-99f9eaebe653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:11.085915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c34317-517e-439c-9168-99f9eaebe653 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-f8c34317-517e-439c-9168-99f9eaebe653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:11.101151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:11.102074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:11.102922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:11.102922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:11.102922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:11.102922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 230/462] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:11.103750 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34317-517e-439c-9168-99f9eaebe653 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.107147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:11.107321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c02869-e1a0-4186-8556-f5d03937f52c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:11.142960 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99936a9-ecbf-4922-9cda-3a0ec53acaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:11.143481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99936a9-ecbf-4922-9cda-3a0ec53acaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.143755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99936a9-ecbf-4922-9cda-3a0ec53acaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.144022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99936a9-ecbf-4922-9cda-3a0ec53acaf2 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.144830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99936a9-ecbf-4922-9cda-3a0ec53acaf2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:11.145137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99936a9-ecbf-4922-9cda-3a0ec53acaf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:11.146702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99936a9-ecbf-4922-9cda-3a0ec53acaf2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:11.190908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 233/463] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Oct 24 13:00:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:11.190908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99936a9-ecbf-4922-9cda-3a0ec53acaf2 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.210738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34317-517e-439c-9168-99f9eaebe653 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:11.245848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aff3d4-c6b8-4141-bd4c-4a71ac095331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:11.246849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aff3d4-c6b8-4141-bd4c-4a71ac095331 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.247189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aff3d4-c6b8-4141-bd4c-4a71ac095331 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.247509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aff3d4-c6b8-4141-bd4c-4a71ac095331 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.248743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aff3d4-c6b8-4141-bd4c-4a71ac095331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:11.249056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aff3d4-c6b8-4141-bd4c-4a71ac095331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:11.250431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aff3d4-c6b8-4141-bd4c-4a71ac095331 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:11.266758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 231/464] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:11.266758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aff3d4-c6b8-4141-bd4c-4a71ac095331 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.295800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:11.299873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99936a9-ecbf-4922-9cda-3a0ec53acaf2 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:11.331862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:11.337175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a10e24-bf21-4864-bdd5-711fcef10868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:11.337821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a10e24-bf21-4864-bdd5-711fcef10868 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.338098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a10e24-bf21-4864-bdd5-711fcef10868 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.338365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a10e24-bf21-4864-bdd5-711fcef10868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.348565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a10e24-bf21-4864-bdd5-711fcef10868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:11.350035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a10e24-bf21-4864-bdd5-711fcef10868 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-69a10e24-bf21-4864-bdd5-711fcef10868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:11.365628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:11.366570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:11.367416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:11.367416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:11.367416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:11.367416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 234/465] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:11.367818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a10e24-bf21-4864-bdd5-711fcef10868 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.381154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aff3d4-c6b8-4141-bd4c-4a71ac095331 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:11.417960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dc5cf-0886-4a72-a5c6-1f5cbcb9cbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:11.418574 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dc5cf-0886-4a72-a5c6-1f5cbcb9cbbd None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.418851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dc5cf-0886-4a72-a5c6-1f5cbcb9cbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.419121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dc5cf-0886-4a72-a5c6-1f5cbcb9cbbd None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.419796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471dc5cf-0886-4a72-a5c6-1f5cbcb9cbbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:11.420097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471dc5cf-0886-4a72-a5c6-1f5cbcb9cbbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:11.421502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471dc5cf-0886-4a72-a5c6-1f5cbcb9cbbd None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:11.437609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 232/466] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:11.437609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dc5cf-0886-4a72-a5c6-1f5cbcb9cbbd None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.479638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a10e24-bf21-4864-bdd5-711fcef10868 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:11.517757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afee0-ac3f-4082-b036-f0e21bd0e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:11.518390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afee0-ac3f-4082-b036-f0e21bd0e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.518664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afee0-ac3f-4082-b036-f0e21bd0e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.518931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afee0-ac3f-4082-b036-f0e21bd0e2b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.541397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:11.548219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dc5cf-0886-4a72-a5c6-1f5cbcb9cbbd None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:11.573183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:11.587547 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a1721-eec8-49f2-b24a-17e73475cbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:11.588447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a1721-eec8-49f2-b24a-17e73475cbbc None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.588724 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a1721-eec8-49f2-b24a-17e73475cbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.589605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a1721-eec8-49f2-b24a-17e73475cbbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.591258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489afee0-ac3f-4082-b036-f0e21bd0e2b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:11.592779 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489afee0-ac3f-4082-b036-f0e21bd0e2b8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:11.597893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a1721-eec8-49f2-b24a-17e73475cbbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:11.599319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a1721-eec8-49f2-b24a-17e73475cbbc None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-a57a1721-eec8-49f2-b24a-17e73475cbbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:11.614149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:11.615428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:11.616266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:11.616266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:11.616266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:11.616266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:11.616266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:11.616266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:11.616266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:11.616266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:11.616707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 233/467] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:11.617227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a1721-eec8-49f2-b24a-17e73475cbbc None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.703775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 235/468] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:11.704484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afee0-ac3f-4082-b036-f0e21bd0e2b8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.730586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a1721-eec8-49f2-b24a-17e73475cbbc None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:11.756061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:11.770857 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16743937-a0bd-4775-afeb-1288c91fa578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:11.771452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16743937-a0bd-4775-afeb-1288c91fa578 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.771728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16743937-a0bd-4775-afeb-1288c91fa578 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.771995 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16743937-a0bd-4775-afeb-1288c91fa578 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.772669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16743937-a0bd-4775-afeb-1288c91fa578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:11.772969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16743937-a0bd-4775-afeb-1288c91fa578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:11.774382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16743937-a0bd-4775-afeb-1288c91fa578 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:11.785866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 234/469] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:11.786706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16743937-a0bd-4775-afeb-1288c91fa578 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.818449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afee0-ac3f-4082-b036-f0e21bd0e2b8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:11.833833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:11.858998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01add4df-8009-44dc-aebd-3eb4d193987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:11.859645 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01add4df-8009-44dc-aebd-3eb4d193987e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.859925 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01add4df-8009-44dc-aebd-3eb4d193987e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.860199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01add4df-8009-44dc-aebd-3eb4d193987e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.868319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01add4df-8009-44dc-aebd-3eb4d193987e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:11.869999 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01add4df-8009-44dc-aebd-3eb4d193987e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-01add4df-8009-44dc-aebd-3eb4d193987e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:11.882843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:11.883759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:11.884716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 236/470] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:11.885800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01add4df-8009-44dc-aebd-3eb4d193987e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.901101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16743937-a0bd-4775-afeb-1288c91fa578 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:11.936696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635420dc-ef4c-40f5-a6e6-a49a96ccaf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:11.937320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635420dc-ef4c-40f5-a6e6-a49a96ccaf8e None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:11.937594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635420dc-ef4c-40f5-a6e6-a49a96ccaf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:11.937864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635420dc-ef4c-40f5-a6e6-a49a96ccaf8e None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:11.938560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635420dc-ef4c-40f5-a6e6-a49a96ccaf8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:11.938864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635420dc-ef4c-40f5-a6e6-a49a96ccaf8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:11.940325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635420dc-ef4c-40f5-a6e6-a49a96ccaf8e None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:11.952047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 235/471] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:11.952875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635420dc-ef4c-40f5-a6e6-a49a96ccaf8e None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:11.991848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01add4df-8009-44dc-aebd-3eb4d193987e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.003093 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.026934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3e9f6-9c22-4c2e-bc00-f7177de40375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.027517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e9f6-9c22-4c2e-bc00-f7177de40375 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.027797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e9f6-9c22-4c2e-bc00-f7177de40375 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.028325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e9f6-9c22-4c2e-bc00-f7177de40375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.039756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3e9f6-9c22-4c2e-bc00-f7177de40375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.041253 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3e9f6-9c22-4c2e-bc00-f7177de40375 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-48f3e9f6-9c22-4c2e-bc00-f7177de40375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:12.055259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:12.056118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:12.057290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:12.057290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:12.057290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:12.057290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 237/472] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:12.057290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3e9f6-9c22-4c2e-bc00-f7177de40375 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.063680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635420dc-ef4c-40f5-a6e6-a49a96ccaf8e None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.066739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.100425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e9109-1e0a-47f6-8c97-2f4b44b41075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.101169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9109-1e0a-47f6-8c97-2f4b44b41075 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.101450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9109-1e0a-47f6-8c97-2f4b44b41075 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.101720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9109-1e0a-47f6-8c97-2f4b44b41075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.110004 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e9109-1e0a-47f6-8c97-2f4b44b41075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.111572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e9109-1e0a-47f6-8c97-2f4b44b41075 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-7f9e9109-1e0a-47f6-8c97-2f4b44b41075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:12.123333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:12.124171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:12.125063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:12.125063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:12.125063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:12.125063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:12.125063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:12.125063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:12.125063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:12.125063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:12.125063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 236/473] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:12.125527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e9109-1e0a-47f6-8c97-2f4b44b41075 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.161129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3e9f6-9c22-4c2e-bc00-f7177de40375 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.196261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e24d41-7ef9-43b0-873c-8875a2a7cf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.196907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24d41-7ef9-43b0-873c-8875a2a7cf8f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.197187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24d41-7ef9-43b0-873c-8875a2a7cf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.197458 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24d41-7ef9-43b0-873c-8875a2a7cf8f None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.198196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e24d41-7ef9-43b0-873c-8875a2a7cf8f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:12.198500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e24d41-7ef9-43b0-873c-8875a2a7cf8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.199986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e24d41-7ef9-43b0-873c-8875a2a7cf8f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.221728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 238/474] 10.222.0.15 () {56 vars in 1139 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:12.221728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e24d41-7ef9-43b0-873c-8875a2a7cf8f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.244377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e9109-1e0a-47f6-8c97-2f4b44b41075 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.244920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.279633 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40d5e5-a89a-47ba-9c9c-866f93323035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.280370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40d5e5-a89a-47ba-9c9c-866f93323035 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.280555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40d5e5-a89a-47ba-9c9c-866f93323035 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.280833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40d5e5-a89a-47ba-9c9c-866f93323035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.281566 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40d5e5-a89a-47ba-9c9c-866f93323035 None admin] RBAC: Adding query filter params (role.id=44dc9e93541449b6b5f221c79be8b938, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=a47768a5f86d4c6292099691f6cab1e6) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:12.281876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40d5e5-a89a-47ba-9c9c-866f93323035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.283312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40d5e5-a89a-47ba-9c9c-866f93323035 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.289816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 237/475] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/role_assignments?user.id=a47768a5f86d4c6292099691f6cab1e6&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=44dc9e93541449b6b5f221c79be8b938 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:12.300726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40d5e5-a89a-47ba-9c9c-866f93323035 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.336484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.338720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e24d41-7ef9-43b0-873c-8875a2a7cf8f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.378793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d7a7f-f393-4257-aba9-b3fd21129f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.379438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d7a7f-f393-4257-aba9-b3fd21129f64 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.379718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d7a7f-f393-4257-aba9-b3fd21129f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.379985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d7a7f-f393-4257-aba9-b3fd21129f64 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.380685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d7a7f-f393-4257-aba9-b3fd21129f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:12.380987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d7a7f-f393-4257-aba9-b3fd21129f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.382400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d7a7f-f393-4257-aba9-b3fd21129f64 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.400319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 239/476] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:12.401336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d7a7f-f393-4257-aba9-b3fd21129f64 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.425745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40d5e5-a89a-47ba-9c9c-866f93323035 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.475328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5825af-418d-43d7-958c-ad5633e21951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.476545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5825af-418d-43d7-958c-ad5633e21951 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.477644 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5825af-418d-43d7-958c-ad5633e21951 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.478112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5825af-418d-43d7-958c-ad5633e21951 None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.479279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5825af-418d-43d7-958c-ad5633e21951 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:12.479764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5825af-418d-43d7-958c-ad5633e21951 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.482858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5825af-418d-43d7-958c-ad5633e21951 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.495039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.504447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 238/477] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:12.505694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5825af-418d-43d7-958c-ad5633e21951 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.520185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d7a7f-f393-4257-aba9-b3fd21129f64 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.557409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715d314-8e09-427f-b2f7-befa4df0a027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.558027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d314-8e09-427f-b2f7-befa4df0a027 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.558305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d314-8e09-427f-b2f7-befa4df0a027 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.558574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d314-8e09-427f-b2f7-befa4df0a027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.612598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.627434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5825af-418d-43d7-958c-ad5633e21951 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.640399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715d314-8e09-427f-b2f7-befa4df0a027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.641996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715d314-8e09-427f-b2f7-befa4df0a027 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.668632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685595-8f5f-4f11-b7b5-c1e6ff7627a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.669564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685595-8f5f-4f11-b7b5-c1e6ff7627a2 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.670018 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685595-8f5f-4f11-b7b5-c1e6ff7627a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.670441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685595-8f5f-4f11-b7b5-c1e6ff7627a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.681824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685595-8f5f-4f11-b7b5-c1e6ff7627a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.684653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685595-8f5f-4f11-b7b5-c1e6ff7627a2 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-2c685595-8f5f-4f11-b7b5-c1e6ff7627a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:12.705804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:12.706994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:12.708061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:12.708061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:12.708061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:12.708061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:12.708061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:12.708061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:12.708061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:12.708061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:12.714773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 239/478] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:12.714773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685595-8f5f-4f11-b7b5-c1e6ff7627a2 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.771769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.774923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 240/479] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:12.776338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715d314-8e09-427f-b2f7-befa4df0a027 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.835317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685595-8f5f-4f11-b7b5-c1e6ff7627a2 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.881386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715d314-8e09-427f-b2f7-befa4df0a027 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:12.882278 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2f13d-63cb-4d1a-a898-b0afc54cbc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.883315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2f13d-63cb-4d1a-a898-b0afc54cbc41 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.884532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2f13d-63cb-4d1a-a898-b0afc54cbc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.884954 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2f13d-63cb-4d1a-a898-b0afc54cbc41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.885885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2f13d-63cb-4d1a-a898-b0afc54cbc41 None admin] RBAC: Adding query filter params (role.id=44dc9e93541449b6b5f221c79be8b938, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=c9b6f4afedfc4d45995b8a671e2d01e8) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:12.886336 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2f13d-63cb-4d1a-a898-b0afc54cbc41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.887931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2f13d-63cb-4d1a-a898-b0afc54cbc41 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.896458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 240/480] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/role_assignments?user.id=c9b6f4afedfc4d45995b8a671e2d01e8&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=44dc9e93541449b6b5f221c79be8b938 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:12.897375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2f13d-63cb-4d1a-a898-b0afc54cbc41 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:12.921607 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:12.929949 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c651a1-c895-44b3-9dfa-a2ffc8705094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:12.930949 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c651a1-c895-44b3-9dfa-a2ffc8705094 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.931398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c651a1-c895-44b3-9dfa-a2ffc8705094 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.931841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c651a1-c895-44b3-9dfa-a2ffc8705094 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.933052 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c651a1-c895-44b3-9dfa-a2ffc8705094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:12.933535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c651a1-c895-44b3-9dfa-a2ffc8705094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:12.935237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c651a1-c895-44b3-9dfa-a2ffc8705094 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:12.948412 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 241/481] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:12.950078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaefae3-a7ad-4aa3-8e37-b809467c8e19 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:12.950562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaefae3-a7ad-4aa3-8e37-b809467c8e19 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:12.950835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaefae3-a7ad-4aa3-8e37-b809467c8e19 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:12.956088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 242/482] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:12.956088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaefae3-a7ad-4aa3-8e37-b809467c8e19 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:13.020142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:13.032390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2f13d-63cb-4d1a-a898-b0afc54cbc41 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:13.077585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a7f81-b0d6-41e1-a20e-94dadb5cf1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:13.078250 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7f81-b0d6-41e1-a20e-94dadb5cf1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.078526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7f81-b0d6-41e1-a20e-94dadb5cf1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.078798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7f81-b0d6-41e1-a20e-94dadb5cf1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.091721 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaefae3-a7ad-4aa3-8e37-b809467c8e19 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:13.093388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a7f81-b0d6-41e1-a20e-94dadb5cf1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:13.095879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a7f81-b0d6-41e1-a20e-94dadb5cf1a8 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-998a7f81-b0d6-41e1-a20e-94dadb5cf1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:13.119063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:13.120061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:13.120941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:13.120941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:13.120941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:13.120941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 241/483] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:13.122091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db4b75-7392-4dc6-a659-df9cbd974960 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.122365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db4b75-7392-4dc6-a659-df9cbd974960 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.123465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db4b75-7392-4dc6-a659-df9cbd974960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.139185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3753-9701-4fbb-8820-ba0e4e77a175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:13.140135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3753-9701-4fbb-8820-ba0e4e77a175 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.140481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3753-9701-4fbb-8820-ba0e4e77a175 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.140745 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3753-9701-4fbb-8820-ba0e4e77a175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.141478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3753-9701-4fbb-8820-ba0e4e77a175 None admin] RBAC: Adding query filter params (role.id=44dc9e93541449b6b5f221c79be8b938, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=d66e6f6ea62d439c87d9551286d29615) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:13.141779 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3753-9701-4fbb-8820-ba0e4e77a175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:13.143238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3753-9701-4fbb-8820-ba0e4e77a175 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:13.148019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-90db4b75-7392-4dc6-a659-df9cbd974960 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:13.149573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-90db4b75-7392-4dc6-a659-df9cbd974960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:13.150918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 243/484] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:12 2022] GET /identity/v3/role_assignments?user.id=d66e6f6ea62d439c87d9551286d29615&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=44dc9e93541449b6b5f221c79be8b938 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:13.151669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3753-9701-4fbb-8820-ba0e4e77a175 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:13.234256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:13.252912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 242/485] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:13.301469 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3753-9701-4fbb-8820-ba0e4e77a175 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:13.308080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:13.357009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f36f5-618f-4b14-987d-0c968e610aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:13.357625 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f36f5-618f-4b14-987d-0c968e610aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.357900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f36f5-618f-4b14-987d-0c968e610aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.358166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f36f5-618f-4b14-987d-0c968e610aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.358812 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f36f5-618f-4b14-987d-0c968e610aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:13.359109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f36f5-618f-4b14-987d-0c968e610aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:13.360513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f36f5-618f-4b14-987d-0c968e610aa8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:13.375582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 244/486] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:13.381343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db4b75-7392-4dc6-a659-df9cbd974960 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:13.508287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db4b75-7392-4dc6-a659-df9cbd974960 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:13.545783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee993fb6-75b2-4aa9-bbbe-ed09b81c641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:13.546725 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee993fb6-75b2-4aa9-bbbe-ed09b81c641f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.546725 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee993fb6-75b2-4aa9-bbbe-ed09b81c641f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.547000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee993fb6-75b2-4aa9-bbbe-ed09b81c641f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.548201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f36f5-618f-4b14-987d-0c968e610aa8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:13.554440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee993fb6-75b2-4aa9-bbbe-ed09b81c641f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:13.555836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee993fb6-75b2-4aa9-bbbe-ed09b81c641f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-ee993fb6-75b2-4aa9-bbbe-ed09b81c641f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:13.567193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:13.568125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:13.569639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:13.569639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:13.569639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:13.569639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:13.569639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:13.569639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:13.569639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:13.569639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:13.569639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 243/487] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:13.578391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee993fb6-75b2-4aa9-bbbe-ed09b81c641f None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:13.668652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:13.708809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f36f5-618f-4b14-987d-0c968e610aa8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:13.732215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee993fb6-75b2-4aa9-bbbe-ed09b81c641f None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:13.756667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b821c8c-558d-4fe0-9822-a393593a8363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:13.757307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b821c8c-558d-4fe0-9822-a393593a8363 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.757590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b821c8c-558d-4fe0-9822-a393593a8363 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.757857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b821c8c-558d-4fe0-9822-a393593a8363 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.776418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b821c8c-558d-4fe0-9822-a393593a8363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-1b821c8c-558d-4fe0-9822-a393593a8363 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:13.782055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:13.783117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:13.784094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:13.792199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3d5d-3fa6-4ef1-adad-64558bb6d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:13.792199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3d5d-3fa6-4ef1-adad-64558bb6d720 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:13.792199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3d5d-3fa6-4ef1-adad-64558bb6d720 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:13.792199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3d5d-3fa6-4ef1-adad-64558bb6d720 None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:13.792586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3d5d-3fa6-4ef1-adad-64558bb6d720 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:13.792586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3d5d-3fa6-4ef1-adad-64558bb6d720 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:13.792586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3d5d-3fa6-4ef1-adad-64558bb6d720 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:13.794559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 245/488] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:13.804357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b821c8c-558d-4fe0-9822-a393593a8363 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:13.813299 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 244/489] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:13.819183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3d5d-3fa6-4ef1-adad-64558bb6d720 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:13.853450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:13.991617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b821c8c-558d-4fe0-9822-a393593a8363 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:14.007351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3d5d-3fa6-4ef1-adad-64558bb6d720 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:14.032643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:14.059524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050a617-497f-42c7-9fcd-b7745928104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:14.060737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050a617-497f-42c7-9fcd-b7745928104e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:14.061013 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050a617-497f-42c7-9fcd-b7745928104e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:14.061284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050a617-497f-42c7-9fcd-b7745928104e None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:14.061963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050a617-497f-42c7-9fcd-b7745928104e None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:14.062264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050a617-497f-42c7-9fcd-b7745928104e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:14.063705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050a617-497f-42c7-9fcd-b7745928104e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:14.073691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04f13a-b44d-44a3-a639-097302de8043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:14.074323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04f13a-b44d-44a3-a639-097302de8043 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:14.074601 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04f13a-b44d-44a3-a639-097302de8043 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:14.074872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04f13a-b44d-44a3-a639-097302de8043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:14.075704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04f13a-b44d-44a3-a639-097302de8043 None admin] RBAC: Adding query filter params (role.id=44dc9e93541449b6b5f221c79be8b938, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=974f2acdadf14df69cbe33351ee02a17) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:14.076009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04f13a-b44d-44a3-a639-097302de8043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:14.077588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04f13a-b44d-44a3-a639-097302de8043 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:14.084665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 246/490] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:14.089001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050a617-497f-42c7-9fcd-b7745928104e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:14.090350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 245/491] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:13 2022] GET /identity/v3/role_assignments?user.id=974f2acdadf14df69cbe33351ee02a17&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=44dc9e93541449b6b5f221c79be8b938 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:14.184602 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:14.201410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050a617-497f-42c7-9fcd-b7745928104e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:14.239929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecee866-22ae-4e85-839b-0edddde8def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:14.240623 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecee866-22ae-4e85-839b-0edddde8def6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:14.240904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecee866-22ae-4e85-839b-0edddde8def6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:14.241175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecee866-22ae-4e85-839b-0edddde8def6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:14.253984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecee866-22ae-4e85-839b-0edddde8def6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:14.255507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecee866-22ae-4e85-839b-0edddde8def6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-cecee866-22ae-4e85-839b-0edddde8def6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:14.271891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:14.272898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:14.274256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:14.274256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:14.274256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:14.274256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 247/492] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:14.281515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04f13a-b44d-44a3-a639-097302de8043 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:14.388200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04f13a-b44d-44a3-a639-097302de8043 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:14.429900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe4b6d-f73d-4c80-93c9-148f7b7f1f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:14.430961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe4b6d-f73d-4c80-93c9-148f7b7f1f80 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:14.431447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe4b6d-f73d-4c80-93c9-148f7b7f1f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:14.431982 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe4b6d-f73d-4c80-93c9-148f7b7f1f80 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:14.432870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe4b6d-f73d-4c80-93c9-148f7b7f1f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:14.433362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe4b6d-f73d-4c80-93c9-148f7b7f1f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:14.434936 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe4b6d-f73d-4c80-93c9-148f7b7f1f80 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:14.452486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 246/493] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:14.457956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecee866-22ae-4e85-839b-0edddde8def6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:14.572324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecee866-22ae-4e85-839b-0edddde8def6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:14.618311 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22445629-30eb-4f41-9c36-b61fe43afa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:14.618948 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22445629-30eb-4f41-9c36-b61fe43afa8a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:14.619228 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22445629-30eb-4f41-9c36-b61fe43afa8a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:14.619503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22445629-30eb-4f41-9c36-b61fe43afa8a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:14.627713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22445629-30eb-4f41-9c36-b61fe43afa8a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:14.629277 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22445629-30eb-4f41-9c36-b61fe43afa8a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-22445629-30eb-4f41-9c36-b61fe43afa8a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:14.640673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:14.641586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:14.642500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 248/494] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:14.644892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:14.647639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe4b6d-f73d-4c80-93c9-148f7b7f1f80 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:14.718770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:14.800250 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe4b6d-f73d-4c80-93c9-148f7b7f1f80 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:14.845458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7f7e1-520b-4a74-9612-e06238a67aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:14.848334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f7e1-520b-4a74-9612-e06238a67aff None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:14.848334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f7e1-520b-4a74-9612-e06238a67aff None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:14.848334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f7e1-520b-4a74-9612-e06238a67aff None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:14.848334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7f7e1-520b-4a74-9612-e06238a67aff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:14.848334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7f7e1-520b-4a74-9612-e06238a67aff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:14.849065 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7f7e1-520b-4a74-9612-e06238a67aff None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:14.874392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 247/495] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Oct 24 13:00:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:14.879133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22445629-30eb-4f41-9c36-b61fe43afa8a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.001330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22445629-30eb-4f41-9c36-b61fe43afa8a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:15.041209 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c2d9-6050-4231-aa5d-d9652c57a300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:15.041829 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c2d9-6050-4231-aa5d-d9652c57a300 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.042108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c2d9-6050-4231-aa5d-d9652c57a300 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.042380 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c2d9-6050-4231-aa5d-d9652c57a300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.101579 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848656b-531a-42ec-a50a-ace74ebf477a None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.101893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848656b-531a-42ec-a50a-ace74ebf477a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.102124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848656b-531a-42ec-a50a-ace74ebf477a None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.103482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 248/496] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:15.108679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7ba6-4c45-40eb-a5ca-d7e34387f716 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.108955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7ba6-4c45-40eb-a5ca-d7e34387f716 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.109220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7ba6-4c45-40eb-a5ca-d7e34387f716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.130370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-19cb7ba6-4c45-40eb-a5ca-d7e34387f716 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:15.131784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-19cb7ba6-4c45-40eb-a5ca-d7e34387f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:15.135035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:15.142971 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9c2d9-6050-4231-aa5d-d9652c57a300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:15.145176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9c2d9-6050-4231-aa5d-d9652c57a300 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:15.213629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 249/497] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 13:00:15.299365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 249/498] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 13:00:15.304803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7ba6-4c45-40eb-a5ca-d7e34387f716 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.381136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:15.430979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7ba6-4c45-40eb-a5ca-d7e34387f716 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:15.465169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1da7b-d26e-4b61-a6b3-a37a31ab85d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:15.465810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1da7b-d26e-4b61-a6b3-a37a31ab85d1 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.466090 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1da7b-d26e-4b61-a6b3-a37a31ab85d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.466360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1da7b-d26e-4b61-a6b3-a37a31ab85d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.477355 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1da7b-d26e-4b61-a6b3-a37a31ab85d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:15.478883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1da7b-d26e-4b61-a6b3-a37a31ab85d1 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-aee1da7b-d26e-4b61-a6b3-a37a31ab85d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:15.498577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:15.499584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:15.500498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:15.500498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:15.500498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:15.500498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 250/499] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:15.506083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c2d9-6050-4231-aa5d-d9652c57a300 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.518404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1da7b-d26e-4b61-a6b3-a37a31ab85d1 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.612832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:15.632381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1da7b-d26e-4b61-a6b3-a37a31ab85d1 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:15.680229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b4b5d-0a97-40cb-b098-13fe1b50da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:15.680899 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4b5d-0a97-40cb-b098-13fe1b50da2e None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.681273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4b5d-0a97-40cb-b098-13fe1b50da2e None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.681548 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4b5d-0a97-40cb-b098-13fe1b50da2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.692886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b4b5d-0a97-40cb-b098-13fe1b50da2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:15.694571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b4b5d-0a97-40cb-b098-13fe1b50da2e None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:15.699416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:15.703512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c2d9-6050-4231-aa5d-d9652c57a300 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-394b4b5d-0a97-40cb-b098-13fe1b50da2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:15.711803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:15.712879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:15.714223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:15.714223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:15.714223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:15.714223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 251/500] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:15.719652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29863ff4-600e-4a9b-87dc-b8e71e5b5266 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.719652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29863ff4-600e-4a9b-87dc-b8e71e5b5266 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.719652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29863ff4-600e-4a9b-87dc-b8e71e5b5266 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.719652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 252/501] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:15.720799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29863ff4-600e-4a9b-87dc-b8e71e5b5266 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.749648 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5e1e8-26f3-4efd-becb-773534142af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:15.750282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e1e8-26f3-4efd-becb-773534142af2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.750563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e1e8-26f3-4efd-becb-773534142af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.750944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e1e8-26f3-4efd-becb-773534142af2 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.751718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5e1e8-26f3-4efd-becb-773534142af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:15.752028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5e1e8-26f3-4efd-becb-773534142af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:15.753535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5e1e8-26f3-4efd-becb-773534142af2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:15.771661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 250/502] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:15.773147 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce50099-e8f4-47d0-8ada-c3636d74c0e6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.773437 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce50099-e8f4-47d0-8ada-c3636d74c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.773710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce50099-e8f4-47d0-8ada-c3636d74c0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.794420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-cce50099-e8f4-47d0-8ada-c3636d74c0e6 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:15.795750 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cce50099-e8f4-47d0-8ada-c3636d74c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:15.833285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29863ff4-600e-4a9b-87dc-b8e71e5b5266 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:15.862685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:15.870611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9796095-7ed1-4edd-95fa-ff5cc153dca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:15.871164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9796095-7ed1-4edd-95fa-ff5cc153dca2 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.871440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9796095-7ed1-4edd-95fa-ff5cc153dca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.871712 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9796095-7ed1-4edd-95fa-ff5cc153dca2 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.872389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9796095-7ed1-4edd-95fa-ff5cc153dca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:15.872691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9796095-7ed1-4edd-95fa-ff5cc153dca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:15.874441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9796095-7ed1-4edd-95fa-ff5cc153dca2 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:15.877275 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 251/503] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:15.878197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce50099-e8f4-47d0-8ada-c3636d74c0e6 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.893042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 253/504] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:15.893042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9fa8-b8ee-4984-a417-bcaf397529c0 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:15.893042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9fa8-b8ee-4984-a417-bcaf397529c0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:15.893042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9fa8-b8ee-4984-a417-bcaf397529c0 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:15.893393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 254/505] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:15.895335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a9fa8-b8ee-4984-a417-bcaf397529c0 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:15.977915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:15.990981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce50099-e8f4-47d0-8ada-c3636d74c0e6 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:15.999867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a9fa8-b8ee-4984-a417-bcaf397529c0 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.027602 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af3f8e-e704-4f4a-8d5d-54fbc50d5f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.028678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3f8e-e704-4f4a-8d5d-54fbc50d5f02 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.029158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3f8e-e704-4f4a-8d5d-54fbc50d5f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.029626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3f8e-e704-4f4a-8d5d-54fbc50d5f02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.035961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422187-bb26-4152-8c22-8866e1f0d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.036611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422187-bb26-4152-8c22-8866e1f0d1ac None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.036946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422187-bb26-4152-8c22-8866e1f0d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.037220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422187-bb26-4152-8c22-8866e1f0d1ac None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.037919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422187-bb26-4152-8c22-8866e1f0d1ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.039402 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422187-bb26-4152-8c22-8866e1f0d1ac None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.040088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af3f8e-e704-4f4a-8d5d-54fbc50d5f02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.041746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af3f8e-e704-4f4a-8d5d-54fbc50d5f02 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-32af3f8e-e704-4f4a-8d5d-54fbc50d5f02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:16.054729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:16.055720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:16.057138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:16.057138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:16.057138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:16.057138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:16.057138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:16.057138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:16.057138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:16.057138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:16.059412 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 252/506] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:16.060847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25738b-0815-40dc-b74e-5eb143eefa50 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.061419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25738b-0815-40dc-b74e-5eb143eefa50 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.061851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25738b-0815-40dc-b74e-5eb143eefa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.065279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 255/507] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:15 2022] POST /identity/v3/users => generated 254 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:16.066641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422187-bb26-4152-8c22-8866e1f0d1ac None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.082286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-fe25738b-0815-40dc-b74e-5eb143eefa50 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:16.083948 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fe25738b-0815-40dc-b74e-5eb143eefa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:16.124041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.158332 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 253/508] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:16.164322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25738b-0815-40dc-b74e-5eb143eefa50 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.223191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422187-bb26-4152-8c22-8866e1f0d1ac None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.298246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b73f6b-11ff-49da-9147-2af37c6ec5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.298878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b73f6b-11ff-49da-9147-2af37c6ec5df None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.299146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b73f6b-11ff-49da-9147-2af37c6ec5df None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.299415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b73f6b-11ff-49da-9147-2af37c6ec5df None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.300115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b73f6b-11ff-49da-9147-2af37c6ec5df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:16.300479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b73f6b-11ff-49da-9147-2af37c6ec5df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.301974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b73f6b-11ff-49da-9147-2af37c6ec5df None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.328691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 256/509] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:16.329363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.331783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b73f6b-11ff-49da-9147-2af37c6ec5df None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.359922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25738b-0815-40dc-b74e-5eb143eefa50 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.405100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba946432-52c4-4641-b3de-1534fdf7220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.406185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba946432-52c4-4641-b3de-1534fdf7220b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.406713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba946432-52c4-4641-b3de-1534fdf7220b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.407203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba946432-52c4-4641-b3de-1534fdf7220b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.407987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba946432-52c4-4641-b3de-1534fdf7220b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.409740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba946432-52c4-4641-b3de-1534fdf7220b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-ba946432-52c4-4641-b3de-1534fdf7220b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:16.421370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:16.422420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:00:16.423274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:16.428411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 254/510] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:16.432353 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba946432-52c4-4641-b3de-1534fdf7220b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.445723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b73f6b-11ff-49da-9147-2af37c6ec5df None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.454698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.487675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c11552-4445-464b-95af-e5561ea04e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.488517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c11552-4445-464b-95af-e5561ea04e63 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.488798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c11552-4445-464b-95af-e5561ea04e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.489181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c11552-4445-464b-95af-e5561ea04e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.489924 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c11552-4445-464b-95af-e5561ea04e63 None admin] RBAC: Adding query filter params (role.id=44dc9e93541449b6b5f221c79be8b938, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=2e1fbb5f8a384aac98e17bd622e25eec) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:16.490232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c11552-4445-464b-95af-e5561ea04e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.491700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c11552-4445-464b-95af-e5561ea04e63 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.499550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 257/511] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/role_assignments?user.id=2e1fbb5f8a384aac98e17bd622e25eec&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=44dc9e93541449b6b5f221c79be8b938 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:16.504345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c11552-4445-464b-95af-e5561ea04e63 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.597140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba946432-52c4-4641-b3de-1534fdf7220b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.674559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15440d5-a89c-45a7-a1cc-67cd208c1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.675591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15440d5-a89c-45a7-a1cc-67cd208c1748 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.676053 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15440d5-a89c-45a7-a1cc-67cd208c1748 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.676543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15440d5-a89c-45a7-a1cc-67cd208c1748 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.677382 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15440d5-a89c-45a7-a1cc-67cd208c1748 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:16.677873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15440d5-a89c-45a7-a1cc-67cd208c1748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.679490 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15440d5-a89c-45a7-a1cc-67cd208c1748 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.691747 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 255/512] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:16.697825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15440d5-a89c-45a7-a1cc-67cd208c1748 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.703736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c11552-4445-464b-95af-e5561ea04e63 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.713011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.760473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea1dc5-5890-4729-8ea5-0660527780e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.761927 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea1dc5-5890-4729-8ea5-0660527780e6 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.762472 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea1dc5-5890-4729-8ea5-0660527780e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.762962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea1dc5-5890-4729-8ea5-0660527780e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.777665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea1dc5-5890-4729-8ea5-0660527780e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-4aea1dc5-5890-4729-8ea5-0660527780e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:16.784073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:16.785219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:16.786058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:16.789967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 258/513] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:16.797452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea1dc5-5890-4729-8ea5-0660527780e6 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:16.836684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:16.853542 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15440d5-a89c-45a7-a1cc-67cd208c1748 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.895805 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c3e6f-20d1-45b5-869c-c40fd949ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.897069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3e6f-20d1-45b5-869c-c40fd949ae9c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.897354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3e6f-20d1-45b5-869c-c40fd949ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.897627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3e6f-20d1-45b5-869c-c40fd949ae9c None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.898273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c3e6f-20d1-45b5-869c-c40fd949ae9c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:16.898579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c3e6f-20d1-45b5-869c-c40fd949ae9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.900222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c3e6f-20d1-45b5-869c-c40fd949ae9c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:16.908764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 256/514] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:16.910222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7deebf-cd2b-4702-b94c-33010d5159ac None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.910598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7deebf-cd2b-4702-b94c-33010d5159ac None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.910973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7deebf-cd2b-4702-b94c-33010d5159ac None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.916663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 257/515] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:16.918046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee788-e1b0-4bb8-a01f-b658330acc0d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.918326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee788-e1b0-4bb8-a01f-b658330acc0d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.918593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee788-e1b0-4bb8-a01f-b658330acc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.937506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-238ee788-e1b0-4bb8-a01f-b658330acc0d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:16.938639 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-238ee788-e1b0-4bb8-a01f-b658330acc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:16.940834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea1dc5-5890-4729-8ea5-0660527780e6 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:16.982531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ad03-b1ce-40e5-8d86-5c62cbcc4f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:16.983253 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ad03-b1ce-40e5-8d86-5c62cbcc4f8f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:16.983622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ad03-b1ce-40e5-8d86-5c62cbcc4f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:16.984003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ad03-b1ce-40e5-8d86-5c62cbcc4f8f None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:16.984807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24ad03-b1ce-40e5-8d86-5c62cbcc4f8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:16.985165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24ad03-b1ce-40e5-8d86-5c62cbcc4f8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:16.986689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24ad03-b1ce-40e5-8d86-5c62cbcc4f8f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.000838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 259/516] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:17.002944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ad03-b1ce-40e5-8d86-5c62cbcc4f8f None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.017211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:17.024400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 258/517] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:17.110723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:17.120988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ad03-b1ce-40e5-8d86-5c62cbcc4f8f None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.158581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b184f-2a74-44a8-8d5d-53b6f4e8e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.159641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b184f-2a74-44a8-8d5d-53b6f4e8e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.160152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b184f-2a74-44a8-8d5d-53b6f4e8e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.160616 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b184f-2a74-44a8-8d5d-53b6f4e8e7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.172557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b184f-2a74-44a8-8d5d-53b6f4e8e7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.174383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b184f-2a74-44a8-8d5d-53b6f4e8e7a9 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-a28b184f-2a74-44a8-8d5d-53b6f4e8e7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:17.190835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:17.191862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:17.192794 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:17.192794 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:17.192794 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:17.194695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 260/518] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:17.201476 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ee788-e1b0-4bb8-a01f-b658330acc0d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.329966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ee788-e1b0-4bb8-a01f-b658330acc0d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.360884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b184f-2a74-44a8-8d5d-53b6f4e8e7a9 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.376150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58fcb8-daec-4672-a5b8-4c40ed43c5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.376810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58fcb8-daec-4672-a5b8-4c40ed43c5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.377094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58fcb8-daec-4672-a5b8-4c40ed43c5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.377369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58fcb8-daec-4672-a5b8-4c40ed43c5b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.378025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58fcb8-daec-4672-a5b8-4c40ed43c5b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:17.378325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58fcb8-daec-4672-a5b8-4c40ed43c5b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.379749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58fcb8-daec-4672-a5b8-4c40ed43c5b2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.400410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 259/519] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:17.407375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58fcb8-daec-4672-a5b8-4c40ed43c5b2 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.507697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b184f-2a74-44a8-8d5d-53b6f4e8e7a9 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.522556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:17.577774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8efce-8c60-4d43-bde3-d3d62cf308bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.578802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8efce-8c60-4d43-bde3-d3d62cf308bc None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.579297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8efce-8c60-4d43-bde3-d3d62cf308bc None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.579787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8efce-8c60-4d43-bde3-d3d62cf308bc None admin] PATH_INFO: `/v3/services/network` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.580613 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8efce-8c60-4d43-bde3-d3d62cf308bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.583408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8efce-8c60-4d43-bde3-d3d62cf308bc None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.594728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58fcb8-daec-4672-a5b8-4c40ed43c5b2 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-5ac8efce-8c60-4d43-bde3-d3d62cf308bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:17.604249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:17.605293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:00:17.606158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:17.616320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 261/520] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:17.619436 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8efce-8c60-4d43-bde3-d3d62cf308bc None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.639654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:17.647457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858d5e4-cf2d-4192-b34e-75c111602865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.648546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858d5e4-cf2d-4192-b34e-75c111602865 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.649146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858d5e4-cf2d-4192-b34e-75c111602865 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.649724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858d5e4-cf2d-4192-b34e-75c111602865 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.659091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858d5e4-cf2d-4192-b34e-75c111602865 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.660992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858d5e4-cf2d-4192-b34e-75c111602865 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-4858d5e4-cf2d-4192-b34e-75c111602865 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:17.673695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:17.674668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:17.675662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:17.675662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:17.675662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:17.675662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:17.675662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:17.675662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:17.675662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:17.675662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:17.675662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:17.675662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:17.678246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 260/521] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:17.685705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858d5e4-cf2d-4192-b34e-75c111602865 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.815418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858d5e4-cf2d-4192-b34e-75c111602865 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.850466 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:17.865704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bd866-06ea-4ea7-98e8-1cf407fc4dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.866333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bd866-06ea-4ea7-98e8-1cf407fc4dba None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.866617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bd866-06ea-4ea7-98e8-1cf407fc4dba None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.866892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bd866-06ea-4ea7-98e8-1cf407fc4dba None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.867631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bd866-06ea-4ea7-98e8-1cf407fc4dba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:17.867944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bd866-06ea-4ea7-98e8-1cf407fc4dba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.869624 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bd866-06ea-4ea7-98e8-1cf407fc4dba None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.882341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8efce-8c60-4d43-bde3-d3d62cf308bc None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:17.889655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 261/522] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:17.897972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bd866-06ea-4ea7-98e8-1cf407fc4dba None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:17.989017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057cd579-42de-4416-95f4-0722cd84cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:17.989641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cd579-42de-4416-95f4-0722cd84cfbd None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:17.989918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cd579-42de-4416-95f4-0722cd84cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:17.990187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cd579-42de-4416-95f4-0722cd84cfbd None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:17.990830 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cd579-42de-4416-95f4-0722cd84cfbd None admin] RBAC: Adding query filter params (name=network) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:17.991125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cd579-42de-4416-95f4-0722cd84cfbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:17.992523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cd579-42de-4416-95f4-0722cd84cfbd None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:17.997457 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 262/523] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:18.008760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057cd579-42de-4416-95f4-0722cd84cfbd None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:18.019094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bd866-06ea-4ea7-98e8-1cf407fc4dba None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:18.091864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:18.104130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f015a-29e2-4bdc-8b27-8fed20b67f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:18.104820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f015a-29e2-4bdc-8b27-8fed20b67f5f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.105096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f015a-29e2-4bdc-8b27-8fed20b67f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.105367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f015a-29e2-4bdc-8b27-8fed20b67f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.130851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f015a-29e2-4bdc-8b27-8fed20b67f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:18.132354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f015a-29e2-4bdc-8b27-8fed20b67f5f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:18.134856 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057cd579-42de-4416-95f4-0722cd84cfbd None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-299f015a-29e2-4bdc-8b27-8fed20b67f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:18.157106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:18.158124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:18.159032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:18.159032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:18.159032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:18.159032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 262/524] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:18.166226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f015a-29e2-4bdc-8b27-8fed20b67f5f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:18.176658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14627a64-8141-484d-92da-1907addfac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:18.177280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14627a64-8141-484d-92da-1907addfac19 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.177554 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14627a64-8141-484d-92da-1907addfac19 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.177823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14627a64-8141-484d-92da-1907addfac19 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.178460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14627a64-8141-484d-92da-1907addfac19 None admin] RBAC: Adding query filter params (type=network) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:18.178760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14627a64-8141-484d-92da-1907addfac19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:18.180139 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14627a64-8141-484d-92da-1907addfac19 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:18.187181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 263/525] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:18.240719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:18.377085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f015a-29e2-4bdc-8b27-8fed20b67f5f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:18.412723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf6751-45d6-4c5c-b8b9-d807b63f4dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:18.413337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf6751-45d6-4c5c-b8b9-d807b63f4dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.413612 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf6751-45d6-4c5c-b8b9-d807b63f4dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.413877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf6751-45d6-4c5c-b8b9-d807b63f4dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.414526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf6751-45d6-4c5c-b8b9-d807b63f4dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:18.414818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf6751-45d6-4c5c-b8b9-d807b63f4dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:18.416199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf6751-45d6-4c5c-b8b9-d807b63f4dc1 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:18.430508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 263/526] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:18.437652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14627a64-8141-484d-92da-1907addfac19 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:18.538151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14627a64-8141-484d-92da-1907addfac19 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:18.571548 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e71dd3-1cdb-4d2e-b9ce-1fb8217fdfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:18.572192 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e71dd3-1cdb-4d2e-b9ce-1fb8217fdfbc None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.572490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e71dd3-1cdb-4d2e-b9ce-1fb8217fdfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.572759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e71dd3-1cdb-4d2e-b9ce-1fb8217fdfbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.575533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:18.579876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e71dd3-1cdb-4d2e-b9ce-1fb8217fdfbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:18.581351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e71dd3-1cdb-4d2e-b9ce-1fb8217fdfbc None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-26e71dd3-1cdb-4d2e-b9ce-1fb8217fdfbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:18.593147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:18.594078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:18.595550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:18.595550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:18.595550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:18.595550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:18.595550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:18.595550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:18.595550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:18.595550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:18.595550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 264/527] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:18.601411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf6751-45d6-4c5c-b8b9-d807b63f4dc1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:18.726926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:18.736692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf6751-45d6-4c5c-b8b9-d807b63f4dc1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:18.785931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a27add-a3e3-4bc6-8069-a9760ff0931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:18.786557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a27add-a3e3-4bc6-8069-a9760ff0931d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.786830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a27add-a3e3-4bc6-8069-a9760ff0931d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.787091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a27add-a3e3-4bc6-8069-a9760ff0931d None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.787783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a27add-a3e3-4bc6-8069-a9760ff0931d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:18.788085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a27add-a3e3-4bc6-8069-a9760ff0931d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:18.789551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a27add-a3e3-4bc6-8069-a9760ff0931d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:18.805528 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 264/528] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:18.811026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e71dd3-1cdb-4d2e-b9ce-1fb8217fdfbc None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:18.889918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442c36-3a59-441e-bc51-49e01f4ee7b6 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.890467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442c36-3a59-441e-bc51-49e01f4ee7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.890467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442c36-3a59-441e-bc51-49e01f4ee7b6 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.891925 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 265/529] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:18.906006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef66eaa-e65d-45b2-9996-23229ca8c559 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.906294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef66eaa-e65d-45b2-9996-23229ca8c559 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.906541 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef66eaa-e65d-45b2-9996-23229ca8c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:18.927502 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2ef66eaa-e65d-45b2-9996-23229ca8c559 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:18.928719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2ef66eaa-e65d-45b2-9996-23229ca8c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:18.938536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e71dd3-1cdb-4d2e-b9ce-1fb8217fdfbc None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:18.998717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f407d6e-bb54-41d8-80a8-b422ab30dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:18.999307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f407d6e-bb54-41d8-80a8-b422ab30dc59 None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:18.999581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f407d6e-bb54-41d8-80a8-b422ab30dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:18.999851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f407d6e-bb54-41d8-80a8-b422ab30dc59 None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/d66e6f6ea62d439c87d9551286d29615/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.002766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f407d6e-bb54-41d8-80a8-b422ab30dc59 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=d66e6f6ea62d439c87d9551286d29615, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:19.005123 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f407d6e-bb54-41d8-80a8-b422ab30dc59 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:19.028901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 265/530] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:18 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/d66e6f6ea62d439c87d9551286d29615/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:19.035324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 266/531] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:19.303673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432c659-8ec0-4ede-94de-e63a83804586 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.303854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432c659-8ec0-4ede-94de-e63a83804586 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.304125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432c659-8ec0-4ede-94de-e63a83804586 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.305740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 266/532] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:19.311751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465de372-a9fb-4d81-88c5-8433561e19af None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.312077 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465de372-a9fb-4d81-88c5-8433561e19af None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.312324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465de372-a9fb-4d81-88c5-8433561e19af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.340319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-465de372-a9fb-4d81-88c5-8433561e19af None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:19.341599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-465de372-a9fb-4d81-88c5-8433561e19af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:19.417294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 267/533] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:19.476923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432c659-8ec0-4ede-94de-e63a83804586 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.558981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:19.617255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e330-0702-40a6-94bd-cb1590984d94 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.617594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e330-0702-40a6-94bd-cb1590984d94 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.617836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e330-0702-40a6-94bd-cb1590984d94 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.618588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432c659-8ec0-4ede-94de-e63a83804586 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.619449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 268/534] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:19.629232 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684349c-86d3-4615-ae57-d299528830fd None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.629513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684349c-86d3-4615-ae57-d299528830fd None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.629776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684349c-86d3-4615-ae57-d299528830fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.658797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4684349c-86d3-4615-ae57-d299528830fd None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:19.660924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4684349c-86d3-4615-ae57-d299528830fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:19.667479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed749fe-58b6-4ee9-8f7b-37744475ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:19.667702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:19.668599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed749fe-58b6-4ee9-8f7b-37744475ea05 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.668713 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed749fe-58b6-4ee9-8f7b-37744475ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.668937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed749fe-58b6-4ee9-8f7b-37744475ea05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.689780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed749fe-58b6-4ee9-8f7b-37744475ea05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-9ed749fe-58b6-4ee9-8f7b-37744475ea05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:19.694583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:19.695518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:19.696398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 267/535] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:19.703322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed749fe-58b6-4ee9-8f7b-37744475ea05 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.767108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 269/536] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:19.777449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684349c-86d3-4615-ae57-d299528830fd None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:19.907938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed749fe-58b6-4ee9-8f7b-37744475ea05 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.940005 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:19.967295 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684349c-86d3-4615-ae57-d299528830fd None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:19.978039 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff29099-70f7-4c18-93ce-5c424f2a5816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:19.978669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff29099-70f7-4c18-93ce-5c424f2a5816 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:19.978943 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff29099-70f7-4c18-93ce-5c424f2a5816 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:19.979215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff29099-70f7-4c18-93ce-5c424f2a5816 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:19.979892 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff29099-70f7-4c18-93ce-5c424f2a5816 None admin] RBAC: Adding query filter params (name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:19.980206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff29099-70f7-4c18-93ce-5c424f2a5816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:19.981649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff29099-70f7-4c18-93ce-5c424f2a5816 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:19.995368 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 268/537] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:20.001363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff29099-70f7-4c18-93ce-5c424f2a5816 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.038851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d61d-d644-466e-8182-9924826be027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.039505 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d61d-d644-466e-8182-9924826be027 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.039782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d61d-d644-466e-8182-9924826be027 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.040053 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d61d-d644-466e-8182-9924826be027 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.052338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:20.055674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d61d-d644-466e-8182-9924826be027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-6296d61d-d644-466e-8182-9924826be027 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:20.061970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:20.062919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:20.063751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:20.068373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 270/538] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:20.070686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d61d-d644-466e-8182-9924826be027 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.135336 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff29099-70f7-4c18-93ce-5c424f2a5816 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.174249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b1f18-3d72-4cf7-bc80-3974bec08ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.175280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b1f18-3d72-4cf7-bc80-3974bec08ddb None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.176398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b1f18-3d72-4cf7-bc80-3974bec08ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.176874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b1f18-3d72-4cf7-bc80-3974bec08ddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.191172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b1f18-3d72-4cf7-bc80-3974bec08ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.193210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b1f18-3d72-4cf7-bc80-3974bec08ddb None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.201406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d61d-d644-466e-8182-9924826be027 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-5d1b1f18-3d72-4cf7-bc80-3974bec08ddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:20.211091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:20.212047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:20.212985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:20.212985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:20.212985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:20.216695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 269/539] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:20.217787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b1f18-3d72-4cf7-bc80-3974bec08ddb None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.244673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24349d-ab4e-4283-9c7d-6b0f1dbb0996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.245154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24349d-ab4e-4283-9c7d-6b0f1dbb0996 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.245438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24349d-ab4e-4283-9c7d-6b0f1dbb0996 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.245708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24349d-ab4e-4283-9c7d-6b0f1dbb0996 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.246361 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24349d-ab4e-4283-9c7d-6b0f1dbb0996 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.247737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24349d-ab4e-4283-9c7d-6b0f1dbb0996 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.256958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:20.276441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 271/540] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:00:20 2022] POST /identity/v3/services => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:20.277655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24349d-ab4e-4283-9c7d-6b0f1dbb0996 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.394802 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:20.395502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b1f18-3d72-4cf7-bc80-3974bec08ddb None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.442566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24349d-ab4e-4283-9c7d-6b0f1dbb0996 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.495091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b4e97-cee8-48d9-9b25-2f1b67adc6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.495091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b4e97-cee8-48d9-9b25-2f1b67adc6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.495373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b4e97-cee8-48d9-9b25-2f1b67adc6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.495701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b4e97-cee8-48d9-9b25-2f1b67adc6e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.496207 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b4e97-cee8-48d9-9b25-2f1b67adc6e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:20.496539 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b4e97-cee8-48d9-9b25-2f1b67adc6e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.498710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b4e97-cee8-48d9-9b25-2f1b67adc6e0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.500964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0e0a8-829b-45c0-a708-a6553931e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.501642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e0a8-829b-45c0-a708-a6553931e642 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.501960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e0a8-829b-45c0-a708-a6553931e642 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.502235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e0a8-829b-45c0-a708-a6553931e642 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.503040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0e0a8-829b-45c0-a708-a6553931e642 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:20.503345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0e0a8-829b-45c0-a708-a6553931e642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.504843 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0e0a8-829b-45c0-a708-a6553931e642 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.520315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 270/541] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:20.521926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 272/542] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:20.527237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0e0a8-829b-45c0-a708-a6553931e642 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.528529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b4e97-cee8-48d9-9b25-2f1b67adc6e0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.654261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:20.667611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b4e97-cee8-48d9-9b25-2f1b67adc6e0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.668109 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0e0a8-829b-45c0-a708-a6553931e642 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.686910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:20.710442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082cc01-c312-450e-a075-2bbf72eb7bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.711115 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082cc01-c312-450e-a075-2bbf72eb7bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.711393 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082cc01-c312-450e-a075-2bbf72eb7bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.711516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739bb1b-0c89-4f17-92fd-292daa70435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.711719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082cc01-c312-450e-a075-2bbf72eb7bf5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.712070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739bb1b-0c89-4f17-92fd-292daa70435c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.712413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739bb1b-0c89-4f17-92fd-292daa70435c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.712703 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739bb1b-0c89-4f17-92fd-292daa70435c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.720122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082cc01-c312-450e-a075-2bbf72eb7bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.721774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082cc01-c312-450e-a075-2bbf72eb7bf5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.723877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739bb1b-0c89-4f17-92fd-292daa70435c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.726073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739bb1b-0c89-4f17-92fd-292daa70435c None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b082cc01-c312-450e-a075-2bbf72eb7bf5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:20.735460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:20.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:20.737869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 273/543] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:20.738470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f61a8-ec37-47c2-8466-fd09040da7ca None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.738470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f61a8-ec37-47c2-8466-fd09040da7ca None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.738882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f61a8-ec37-47c2-8466-fd09040da7ca None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.744709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 274/544] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:20.745480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f61a8-ec37-47c2-8466-fd09040da7ca None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-3739bb1b-0c89-4f17-92fd-292daa70435c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:20.746912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:20.748239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:20.749722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:20.749722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:20.749722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:20.757230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 271/545] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:20.758853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78c021-93d5-4ab4-86c4-76846a4f390a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.759758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78c021-93d5-4ab4-86c4-76846a4f390a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.760270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78c021-93d5-4ab4-86c4-76846a4f390a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.782964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-cf78c021-93d5-4ab4-86c4-76846a4f390a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:20.784730 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cf78c021-93d5-4ab4-86c4-76846a4f390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:20.870466 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f61a8-ec37-47c2-8466-fd09040da7ca None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:20.874871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 272/546] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 13:00:20.875973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78c021-93d5-4ab4-86c4-76846a4f390a None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:20.924684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89332d0-a648-4c39-a6d3-45f0fb9d0fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:20.925691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89332d0-a648-4c39-a6d3-45f0fb9d0fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:20.926149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89332d0-a648-4c39-a6d3-45f0fb9d0fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:20.926619 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89332d0-a648-4c39-a6d3-45f0fb9d0fb7 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:20.927600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89332d0-a648-4c39-a6d3-45f0fb9d0fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:20.928097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89332d0-a648-4c39-a6d3-45f0fb9d0fb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:20.929792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89332d0-a648-4c39-a6d3-45f0fb9d0fb7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:20.965505 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 275/547] 10.222.0.15 () {56 vars in 1149 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:20.969582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89332d0-a648-4c39-a6d3-45f0fb9d0fb7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:21.006398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:21.040512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:21.060343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78c021-93d5-4ab4-86c4-76846a4f390a None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:21.094240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9453791-9406-4a36-80a8-df29795e7746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:21.094900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9453791-9406-4a36-80a8-df29795e7746 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.095356 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9453791-9406-4a36-80a8-df29795e7746 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.095630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9453791-9406-4a36-80a8-df29795e7746 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.096370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9453791-9406-4a36-80a8-df29795e7746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:21.096677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9453791-9406-4a36-80a8-df29795e7746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:21.104322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9453791-9406-4a36-80a8-df29795e7746 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:21.110710 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 273/548] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:21.116325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9453791-9406-4a36-80a8-df29795e7746 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:21.164110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89332d0-a648-4c39-a6d3-45f0fb9d0fb7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:21.201851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6785-aaa0-428f-8d20-d0eeebe795dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:21.202505 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6785-aaa0-428f-8d20-d0eeebe795dd None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.202792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6785-aaa0-428f-8d20-d0eeebe795dd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.203054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6785-aaa0-428f-8d20-d0eeebe795dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.214383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e6785-aaa0-428f-8d20-d0eeebe795dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:21.215852 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e6785-aaa0-428f-8d20-d0eeebe795dd None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:21.226474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9453791-9406-4a36-80a8-df29795e7746 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-eb2e6785-aaa0-428f-8d20-d0eeebe795dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:21.231824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:21.232872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:21.234137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:21.234137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:21.234137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:21.234137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 276/549] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:21.234364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6785-aaa0-428f-8d20-d0eeebe795dd None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:21.267193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ef2f7-ca54-4a56-b4fa-21cbf16d0ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:21.267839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ef2f7-ca54-4a56-b4fa-21cbf16d0ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.268118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ef2f7-ca54-4a56-b4fa-21cbf16d0ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.268419 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ef2f7-ca54-4a56-b4fa-21cbf16d0ce4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.270593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:21.278361 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ef2f7-ca54-4a56-b4fa-21cbf16d0ce4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:21.280419 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ef2f7-ca54-4a56-b4fa-21cbf16d0ce4 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-d84ef2f7-ca54-4a56-b4fa-21cbf16d0ce4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:21.293744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:21.295859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:21.298199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:21.298199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:21.298199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:21.298199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:21.298199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:21.298199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:21.298199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:21.298199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:21.298199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:00:21.298199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:21.300783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 274/550] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:21.301414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ef2f7-ca54-4a56-b4fa-21cbf16d0ce4 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:21.342925 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:21.371555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6785-aaa0-428f-8d20-d0eeebe795dd None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:21.412660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ef2f7-ca54-4a56-b4fa-21cbf16d0ce4 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:21.418249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3bef2-a25e-4225-a547-fbd4d5a33fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:21.418874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3bef2-a25e-4225-a547-fbd4d5a33fe0 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.419155 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3bef2-a25e-4225-a547-fbd4d5a33fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.419427 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3bef2-a25e-4225-a547-fbd4d5a33fe0 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.420091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3bef2-a25e-4225-a547-fbd4d5a33fe0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:21.421533 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3bef2-a25e-4225-a547-fbd4d5a33fe0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:21.443961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 277/551] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:00:21 2022] POST /identity/v3/services => generated 240 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:21.445169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3bef2-a25e-4225-a547-fbd4d5a33fe0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:21.470749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac543-567a-4ab7-8a7e-6a5e1380a64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:21.471833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac543-567a-4ab7-8a7e-6a5e1380a64e None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.473368 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac543-567a-4ab7-8a7e-6a5e1380a64e None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.473955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac543-567a-4ab7-8a7e-6a5e1380a64e None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.474868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac543-567a-4ab7-8a7e-6a5e1380a64e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:21.475394 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac543-567a-4ab7-8a7e-6a5e1380a64e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:21.477122 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac543-567a-4ab7-8a7e-6a5e1380a64e None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:21.509911 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 275/552] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:21.511024 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac543-567a-4ab7-8a7e-6a5e1380a64e None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:21.629897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:21.665437 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3bef2-a25e-4225-a547-fbd4d5a33fe0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:21.698862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac543-567a-4ab7-8a7e-6a5e1380a64e None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:21.703570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb91c5b-9c17-4556-929a-d5a66c7076c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:21.704184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91c5b-9c17-4556-929a-d5a66c7076c2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.704488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91c5b-9c17-4556-929a-d5a66c7076c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.704756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91c5b-9c17-4556-929a-d5a66c7076c2 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.705480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb91c5b-9c17-4556-929a-d5a66c7076c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:21.705782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb91c5b-9c17-4556-929a-d5a66c7076c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:21.707306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb91c5b-9c17-4556-929a-d5a66c7076c2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:21.726211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 278/553] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Oct 24 13:00:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:21.727371 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd81fd-3f92-45ec-87c9-18992cef32b5 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.727651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd81fd-3f92-45ec-87c9-18992cef32b5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.727920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd81fd-3f92-45ec-87c9-18992cef32b5 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.729223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 279/554] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:21.734214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd81fd-3f92-45ec-87c9-18992cef32b5 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:21.739247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:21.742965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d360d-8286-47e5-857b-1f99cdaf336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:21.743848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d360d-8286-47e5-857b-1f99cdaf336b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.744767 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d360d-8286-47e5-857b-1f99cdaf336b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.745225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d360d-8286-47e5-857b-1f99cdaf336b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.756064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d360d-8286-47e5-857b-1f99cdaf336b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:21.758256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d360d-8286-47e5-857b-1f99cdaf336b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-175d360d-8286-47e5-857b-1f99cdaf336b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:21.773149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:21.774083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:21.774974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:21.774974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:21.774974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:21.774974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:21.774974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:21.774974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:21.774974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:21.774974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:21.782190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 276/555] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:21.782190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3607c8-b98a-42f2-b16f-8fc0ce5860ce None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.782190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3607c8-b98a-42f2-b16f-8fc0ce5860ce None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.784160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3607c8-b98a-42f2-b16f-8fc0ce5860ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.814124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ff3607c8-b98a-42f2-b16f-8fc0ce5860ce None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:21.816549 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ff3607c8-b98a-42f2-b16f-8fc0ce5860ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:21.871922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd81fd-3f92-45ec-87c9-18992cef32b5 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:21.909318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 277/556] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:21.910365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3607c8-b98a-42f2-b16f-8fc0ce5860ce None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:21.915727 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c595d2-37cc-44e4-a95e-20dc2f50ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:21.916746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c595d2-37cc-44e4-a95e-20dc2f50ae62 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:21.918070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c595d2-37cc-44e4-a95e-20dc2f50ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:21.918537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c595d2-37cc-44e4-a95e-20dc2f50ae62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:21.931561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c595d2-37cc-44e4-a95e-20dc2f50ae62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:21.933510 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c595d2-37cc-44e4-a95e-20dc2f50ae62 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c2c595d2-37cc-44e4-a95e-20dc2f50ae62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:21.951841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:21.952927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:21.953826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:21.953826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:21.953826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:21.956060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 280/557] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:21.961644 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c595d2-37cc-44e4-a95e-20dc2f50ae62 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:21.982740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.030647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.086290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c595d2-37cc-44e4-a95e-20dc2f50ae62 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.086525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3607c8-b98a-42f2-b16f-8fc0ce5860ce None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.146895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e420d4-c9ee-49f2-b22e-e6c436602dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.147515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e420d4-c9ee-49f2-b22e-e6c436602dad None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.147794 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e420d4-c9ee-49f2-b22e-e6c436602dad None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.148077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e420d4-c9ee-49f2-b22e-e6c436602dad None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.148810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e420d4-c9ee-49f2-b22e-e6c436602dad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:22.149114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e420d4-c9ee-49f2-b22e-e6c436602dad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.150542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e420d4-c9ee-49f2-b22e-e6c436602dad None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.152628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb2aa5-083f-4ed2-bc22-9d682af1bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.153243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb2aa5-083f-4ed2-bc22-9d682af1bfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.153521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb2aa5-083f-4ed2-bc22-9d682af1bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.153786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb2aa5-083f-4ed2-bc22-9d682af1bfd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.154425 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb2aa5-083f-4ed2-bc22-9d682af1bfd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:22.154723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb2aa5-083f-4ed2-bc22-9d682af1bfd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.156213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb2aa5-083f-4ed2-bc22-9d682af1bfd6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.175657 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 278/558] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:22.177471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 281/559] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:22.182024 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e420d4-c9ee-49f2-b22e-e6c436602dad None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.185996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb2aa5-083f-4ed2-bc22-9d682af1bfd6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.325566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb2aa5-083f-4ed2-bc22-9d682af1bfd6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.329555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.333508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e420d4-c9ee-49f2-b22e-e6c436602dad None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.350632 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.371791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98de5bc-8f6d-41d7-a63c-b8c709391924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.372489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98de5bc-8f6d-41d7-a63c-b8c709391924 None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.372774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98de5bc-8f6d-41d7-a63c-b8c709391924 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.373406 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98de5bc-8f6d-41d7-a63c-b8c709391924 None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/2ce014df3a294fa5bb209b40f889069f/roles/44dc9e93541449b6b5f221c79be8b938` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.375314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fe659-531e-4f48-8959-83f931e2c8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.376443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe659-531e-4f48-8959-83f931e2c8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.377847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe659-531e-4f48-8959-83f931e2c8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.378356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe659-531e-4f48-8959-83f931e2c8c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.387382 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fe659-531e-4f48-8959-83f931e2c8c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.388829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98de5bc-8f6d-41d7-a63c-b8c709391924 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=2ce014df3a294fa5bb209b40f889069f, role_id=44dc9e93541449b6b5f221c79be8b938)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.389574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fe659-531e-4f48-8959-83f931e2c8c3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.390255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98de5bc-8f6d-41d7-a63c-b8c709391924 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-100fe659-531e-4f48-8959-83f931e2c8c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:22.403603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:22.404621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:22.405543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:22.405543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:22.405543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:22.405543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:22.405543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:22.405543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:22.405543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:22.405543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:22.409607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 282/560] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:22.410471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fe659-531e-4f48-8959-83f931e2c8c3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.416326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 279/561] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:22 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/2ce014df3a294fa5bb209b40f889069f/roles/44dc9e93541449b6b5f221c79be8b938 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:22.417440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98de5bc-8f6d-41d7-a63c-b8c709391924 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.540450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98de5bc-8f6d-41d7-a63c-b8c709391924 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.583646 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84418a-2c53-4d4c-b7a0-766a797a8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.584742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84418a-2c53-4d4c-b7a0-766a797a8e71 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.585224 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84418a-2c53-4d4c-b7a0-766a797a8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.585702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84418a-2c53-4d4c-b7a0-766a797a8e71 None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.586701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84418a-2c53-4d4c-b7a0-766a797a8e71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:22.587249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84418a-2c53-4d4c-b7a0-766a797a8e71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.588964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84418a-2c53-4d4c-b7a0-766a797a8e71 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.614913 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 280/562] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:22.624331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84418a-2c53-4d4c-b7a0-766a797a8e71 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.630521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fe659-531e-4f48-8959-83f931e2c8c3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.641621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.691873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687e234-d59e-4a4e-a5d0-e5466949de29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.692818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687e234-d59e-4a4e-a5d0-e5466949de29 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.693508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687e234-d59e-4a4e-a5d0-e5466949de29 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.693966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687e234-d59e-4a4e-a5d0-e5466949de29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.711498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687e234-d59e-4a4e-a5d0-e5466949de29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-a687e234-d59e-4a4e-a5d0-e5466949de29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:22.716864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:22.717775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:22.718611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:22.724331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 283/563] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:22.726158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687e234-d59e-4a4e-a5d0-e5466949de29 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:22.759547 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84418a-2c53-4d4c-b7a0-766a797a8e71 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.792900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:22.822980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f92666-92b9-4e62-a3b1-5dc305d36d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.823658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92666-92b9-4e62-a3b1-5dc305d36d9d None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.823936 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92666-92b9-4e62-a3b1-5dc305d36d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.824208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92666-92b9-4e62-a3b1-5dc305d36d9d None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/2e1fbb5f8a384aac98e17bd622e25eec/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.831698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f92666-92b9-4e62-a3b1-5dc305d36d9d None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=2e1fbb5f8a384aac98e17bd622e25eec, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.833204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f92666-92b9-4e62-a3b1-5dc305d36d9d None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.862295 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 281/564] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:22 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/2e1fbb5f8a384aac98e17bd622e25eec/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:22.895505 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687e234-d59e-4a4e-a5d0-e5466949de29 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:22.957148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38fa82-bfce-4ee4-b014-517e3f7908c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:22.957840 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38fa82-bfce-4ee4-b014-517e3f7908c5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:22.958115 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38fa82-bfce-4ee4-b014-517e3f7908c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:22.958381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38fa82-bfce-4ee4-b014-517e3f7908c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:22.959108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38fa82-bfce-4ee4-b014-517e3f7908c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:22.959411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38fa82-bfce-4ee4-b014-517e3f7908c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:22.960838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38fa82-bfce-4ee4-b014-517e3f7908c5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:22.970705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 284/565] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:22.976432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f92666-92b9-4e62-a3b1-5dc305d36d9d None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.022933 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1007d-0b17-49f2-9493-3aa6c5b5d25f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.023385 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1007d-0b17-49f2-9493-3aa6c5b5d25f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.023541 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1007d-0b17-49f2-9493-3aa6c5b5d25f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.024876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 285/566] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:23.037429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4fd4-b0f5-46da-ae2d-2fd7eaca5202 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.038194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4fd4-b0f5-46da-ae2d-2fd7eaca5202 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.038194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4fd4-b0f5-46da-ae2d-2fd7eaca5202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.071749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9ebf4fd4-b0f5-46da-ae2d-2fd7eaca5202 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:23.075380 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9ebf4fd4-b0f5-46da-ae2d-2fd7eaca5202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:23.103257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:23.147428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f92666-92b9-4e62-a3b1-5dc305d36d9d None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:23.166890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 286/567] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:23.190802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6a6b8-3642-4d80-8b47-aac782f27b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:23.191588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6a6b8-3642-4d80-8b47-aac782f27b50 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.191872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6a6b8-3642-4d80-8b47-aac782f27b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.192146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6a6b8-3642-4d80-8b47-aac782f27b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.203191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6a6b8-3642-4d80-8b47-aac782f27b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:23.204697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6a6b8-3642-4d80-8b47-aac782f27b50 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-b5a6a6b8-3642-4d80-8b47-aac782f27b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:23.219452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:23.220459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:23.221348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:23.221348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:23.221348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:23.224548 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 282/568] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:23.227011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4fd4-b0f5-46da-ae2d-2fd7eaca5202 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.275101 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:23.372143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4fd4-b0f5-46da-ae2d-2fd7eaca5202 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:23.416219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6e865-849a-4b20-bc2d-95a7d58a272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:23.416872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6e865-849a-4b20-bc2d-95a7d58a272a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.417145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6e865-849a-4b20-bc2d-95a7d58a272a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.417413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6e865-849a-4b20-bc2d-95a7d58a272a None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.418057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6e865-849a-4b20-bc2d-95a7d58a272a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:23.418355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6e865-849a-4b20-bc2d-95a7d58a272a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:23.419735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6e865-849a-4b20-bc2d-95a7d58a272a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:23.442714 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6a6b8-3642-4d80-8b47-aac782f27b50 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.444252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 287/569] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:23.457257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6e865-849a-4b20-bc2d-95a7d58a272a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.597557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:23.617305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6a6b8-3642-4d80-8b47-aac782f27b50 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:23.626795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6e865-849a-4b20-bc2d-95a7d58a272a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:23.640869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:23.653648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2936-b008-43f5-ac84-4b8abe550bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:23.654286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2936-b008-43f5-ac84-4b8abe550bbc None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.654561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2936-b008-43f5-ac84-4b8abe550bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.654829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2936-b008-43f5-ac84-4b8abe550bbc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.655417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e2936-b008-43f5-ac84-4b8abe550bbc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:23.656848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e2936-b008-43f5-ac84-4b8abe550bbc None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-3b7e2936-b008-43f5-ac84-4b8abe550bbc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:23.666180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:23.667187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:23.668038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 283/570] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Oct 24 13:00:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:23.675043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2936-b008-43f5-ac84-4b8abe550bbc None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.705591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d947-d3f4-4f92-9cef-c2b1b0a56e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:23.706247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d947-d3f4-4f92-9cef-c2b1b0a56e8d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.706562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d947-d3f4-4f92-9cef-c2b1b0a56e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.706845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d947-d3f4-4f92-9cef-c2b1b0a56e8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.720832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81d947-d3f4-4f92-9cef-c2b1b0a56e8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:23.722750 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81d947-d3f4-4f92-9cef-c2b1b0a56e8d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-cf81d947-d3f4-4f92-9cef-c2b1b0a56e8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:23.742022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:23.743139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:23.744083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:23.744083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:23.744083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:23.744083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:23.744083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:23.744083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:23.744083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:23.744083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:23.744083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:23.744083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:23.746722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 288/571] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Oct 24 13:00:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:23.752799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d947-d3f4-4f92-9cef-c2b1b0a56e8d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.781059 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2936-b008-43f5-ac84-4b8abe550bbc None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:23.815983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e451b2-37fe-4d06-a013-207337c61543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:23.816638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e451b2-37fe-4d06-a013-207337c61543 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:23.816916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e451b2-37fe-4d06-a013-207337c61543 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:23.817188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e451b2-37fe-4d06-a013-207337c61543 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:23.817827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e451b2-37fe-4d06-a013-207337c61543 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:23.818133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e451b2-37fe-4d06-a013-207337c61543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:23.819514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e451b2-37fe-4d06-a013-207337c61543 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:23.824939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 284/572] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Oct 24 13:00:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:23.838211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e451b2-37fe-4d06-a013-207337c61543 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:23.912016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:23.945505 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d947-d3f4-4f92-9cef-c2b1b0a56e8d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:23.966352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e451b2-37fe-4d06-a013-207337c61543 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:24.002023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c512df-5bd9-4e75-98aa-51a999c1f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:24.003149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c512df-5bd9-4e75-98aa-51a999c1f2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.003666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c512df-5bd9-4e75-98aa-51a999c1f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.004132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c512df-5bd9-4e75-98aa-51a999c1f2e5 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.004983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c512df-5bd9-4e75-98aa-51a999c1f2e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:24.005182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e5de4-3d88-454f-9673-5220011371b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:24.005702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c512df-5bd9-4e75-98aa-51a999c1f2e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:24.005806 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e5de4-3d88-454f-9673-5220011371b8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.006078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e5de4-3d88-454f-9673-5220011371b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.006350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e5de4-3d88-454f-9673-5220011371b8 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.007087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e5de4-3d88-454f-9673-5220011371b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:24.007392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e5de4-3d88-454f-9673-5220011371b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:24.008181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c512df-5bd9-4e75-98aa-51a999c1f2e5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:24.008848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e5de4-3d88-454f-9673-5220011371b8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:24.014444 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 285/573] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Oct 24 13:00:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:24.020722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c512df-5bd9-4e75-98aa-51a999c1f2e5 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:24.042768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 289/574] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Oct 24 13:00:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:24.049304 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e5de4-3d88-454f-9673-5220011371b8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:24.061491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:24.135096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c512df-5bd9-4e75-98aa-51a999c1f2e5 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:24.158262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:24.198604 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca573ff-f364-4d3f-b9f4-902084613f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:24.199151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca573ff-f364-4d3f-b9f4-902084613f38 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.199434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca573ff-f364-4d3f-b9f4-902084613f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.199711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca573ff-f364-4d3f-b9f4-902084613f38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.200471 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca573ff-f364-4d3f-b9f4-902084613f38 None admin] RBAC: Adding query filter params (interface=public, service_id=e9017737da544ad9a61630fa3f2a5d63, region_id=RegionOne) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:24.200811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca573ff-f364-4d3f-b9f4-902084613f38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:24.202904 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca573ff-f364-4d3f-b9f4-902084613f38 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:24.211772 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 286/575] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Oct 24 13:00:24 2022] GET /identity/v3/endpoints?service_id=e9017737da544ad9a61630fa3f2a5d63&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:24.216452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35d314-2b02-46b4-828a-a58608f156f0 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.216452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35d314-2b02-46b4-828a-a58608f156f0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.216452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35d314-2b02-46b4-828a-a58608f156f0 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.219636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 287/576] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:24.220567 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35d314-2b02-46b4-828a-a58608f156f0 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:24.233272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e5de4-3d88-454f-9673-5220011371b8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:24.278620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb0c88-70b1-43ea-99a0-a0d43861fde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:24.279899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0c88-70b1-43ea-99a0-a0d43861fde8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.280787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0c88-70b1-43ea-99a0-a0d43861fde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.281281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0c88-70b1-43ea-99a0-a0d43861fde8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.347607 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35d314-2b02-46b4-828a-a58608f156f0 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:24.363625 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb0c88-70b1-43ea-99a0-a0d43861fde8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:24.365128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb0c88-70b1-43ea-99a0-a0d43861fde8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:24.373282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:24.388427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7622415-9eeb-4e8d-9ecd-9ebf879a2423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:24.389578 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7622415-9eeb-4e8d-9ecd-9ebf879a2423 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.390140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7622415-9eeb-4e8d-9ecd-9ebf879a2423 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.390682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7622415-9eeb-4e8d-9ecd-9ebf879a2423 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.391489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7622415-9eeb-4e8d-9ecd-9ebf879a2423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:24.393428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7622415-9eeb-4e8d-9ecd-9ebf879a2423 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:24.404615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 288/577] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Oct 24 13:00:24 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:24.406410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f831d-a233-486d-93e7-4cc3b3ef16c9 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.406941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f831d-a233-486d-93e7-4cc3b3ef16c9 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.407509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f831d-a233-486d-93e7-4cc3b3ef16c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.450767 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8d7f831d-a233-486d-93e7-4cc3b3ef16c9 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:24.451961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8d7f831d-a233-486d-93e7-4cc3b3ef16c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:24.505258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 290/578] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 13:00:24.511222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb0c88-70b1-43ea-99a0-a0d43861fde8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:24.539513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:24.565942 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 289/579] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:24.670325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb0c88-70b1-43ea-99a0-a0d43861fde8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:24.679492 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:24.709310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308b1d-a02b-4867-898a-e057444b102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:24.709887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308b1d-a02b-4867-898a-e057444b102f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.710203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308b1d-a02b-4867-898a-e057444b102f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.710482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308b1d-a02b-4867-898a-e057444b102f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.720706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b308b1d-a02b-4867-898a-e057444b102f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:24.722171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b308b1d-a02b-4867-898a-e057444b102f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-9b308b1d-a02b-4867-898a-e057444b102f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:24.736764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:24.737700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:24.738643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:24.738643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:24.738643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:24.738643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 291/580] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:24.743781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f831d-a233-486d-93e7-4cc3b3ef16c9 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:24.858112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f831d-a233-486d-93e7-4cc3b3ef16c9 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:24.874049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308b1d-a02b-4867-898a-e057444b102f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:24.910026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492b7f4-6035-47ea-b988-6e1745b871b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:24.910706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492b7f4-6035-47ea-b988-6e1745b871b3 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:24.910988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492b7f4-6035-47ea-b988-6e1745b871b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:24.911256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492b7f4-6035-47ea-b988-6e1745b871b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:24.911908 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492b7f4-6035-47ea-b988-6e1745b871b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:24.912204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492b7f4-6035-47ea-b988-6e1745b871b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:24.913846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492b7f4-6035-47ea-b988-6e1745b871b3 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:24.932709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 290/581] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:24.938334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492b7f4-6035-47ea-b988-6e1745b871b3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:24.993600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.025407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308b1d-a02b-4867-898a-e057444b102f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.065193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492b7f4-6035-47ea-b988-6e1745b871b3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.096898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3367f-cffc-4b81-84f7-035ec9ac16d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.098425 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3367f-cffc-4b81-84f7-035ec9ac16d8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.098893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3367f-cffc-4b81-84f7-035ec9ac16d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.100396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3367f-cffc-4b81-84f7-035ec9ac16d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.101185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3367f-cffc-4b81-84f7-035ec9ac16d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.105048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3367f-cffc-4b81-84f7-035ec9ac16d8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.112814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edcc71-1c94-44ab-b3a3-affc5b0160e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.113464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edcc71-1c94-44ab-b3a3-affc5b0160e7 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.113742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edcc71-1c94-44ab-b3a3-affc5b0160e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.114014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edcc71-1c94-44ab-b3a3-affc5b0160e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-29e3367f-cffc-4b81-84f7-035ec9ac16d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:25.118038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:25.118994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:00:25.120003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:25.122398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edcc71-1c94-44ab-b3a3-affc5b0160e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.123652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 292/582] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:24 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:25.124449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edcc71-1c94-44ab-b3a3-affc5b0160e7 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.125491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30d3c-7947-4952-849e-3e23b9c61b09 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.125941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30d3c-7947-4952-849e-3e23b9c61b09 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.126568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30d3c-7947-4952-849e-3e23b9c61b09 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.128706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 293/583] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:25.129642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb30d3c-7947-4952-849e-3e23b9c61b09 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-e8edcc71-1c94-44ab-b3a3-affc5b0160e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:25.142341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:25.143681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:25.144677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:25.144677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:25.144677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:25.144677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:25.144677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:25.144677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:25.144677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:25.144677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:25.144677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 291/584] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:25.145169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce4db-7de6-4222-a71d-b2357b21ff3c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.145722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce4db-7de6-4222-a71d-b2357b21ff3c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.145722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce4db-7de6-4222-a71d-b2357b21ff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.165898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.170473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8b8ce4db-7de6-4222-a71d-b2357b21ff3c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:25.171666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8b8ce4db-7de6-4222-a71d-b2357b21ff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:25.248623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 292/585] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:25.248623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce4db-7de6-4222-a71d-b2357b21ff3c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.282630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.287323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb30d3c-7947-4952-849e-3e23b9c61b09 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.340338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e6ef-1496-4865-a7d9-da9890bfdb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.340338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e6ef-1496-4865-a7d9-da9890bfdb3b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.340338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e6ef-1496-4865-a7d9-da9890bfdb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.340338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e6ef-1496-4865-a7d9-da9890bfdb3b None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.340843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00e6ef-1496-4865-a7d9-da9890bfdb3b None admin] RBAC: Adding query filter params (name=network) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:25.340843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00e6ef-1496-4865-a7d9-da9890bfdb3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.341567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00e6ef-1496-4865-a7d9-da9890bfdb3b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.353939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 294/586] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:25.360339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e6ef-1496-4865-a7d9-da9890bfdb3b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.438484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce4db-7de6-4222-a71d-b2357b21ff3c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.490567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.498155 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1cb97-ca83-4bf2-9104-32414ccfe5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.498806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1cb97-ca83-4bf2-9104-32414ccfe5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.499026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1cb97-ca83-4bf2-9104-32414ccfe5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.499296 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1cb97-ca83-4bf2-9104-32414ccfe5d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.500047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1cb97-ca83-4bf2-9104-32414ccfe5d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:25.500377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1cb97-ca83-4bf2-9104-32414ccfe5d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.501891 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1cb97-ca83-4bf2-9104-32414ccfe5d1 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.515450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e6ef-1496-4865-a7d9-da9890bfdb3b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.518429 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 293/587] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:25.519596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafc1fa-89f9-439b-94ae-d297e5f5981e None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.519875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafc1fa-89f9-439b-94ae-d297e5f5981e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.520146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafc1fa-89f9-439b-94ae-d297e5f5981e None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.525661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 294/588] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:25.526853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0865-cbc5-4f40-8537-dbd64b275393 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.527131 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0865-cbc5-4f40-8537-dbd64b275393 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.527826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0865-cbc5-4f40-8537-dbd64b275393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.547215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c46a0865-cbc5-4f40-8537-dbd64b275393 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:25.548483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c46a0865-cbc5-4f40-8537-dbd64b275393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:25.556079 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5f3f6-13e6-4f24-81cc-f3931711873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.556737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5f3f6-13e6-4f24-81cc-f3931711873f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.557014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5f3f6-13e6-4f24-81cc-f3931711873f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.557292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5f3f6-13e6-4f24-81cc-f3931711873f None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.557918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5f3f6-13e6-4f24-81cc-f3931711873f None admin] RBAC: Adding query filter params (type=network) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:25.558218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5f3f6-13e6-4f24-81cc-f3931711873f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.559602 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5f3f6-13e6-4f24-81cc-f3931711873f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.565088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 295/589] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:25.565992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5f3f6-13e6-4f24-81cc-f3931711873f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.626100 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 295/590] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:25.626950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a0865-cbc5-4f40-8537-dbd64b275393 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.649490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.697271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5f3f6-13e6-4f24-81cc-f3931711873f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.745798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ce635-db2b-4a03-ac23-3ab6f0d71dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.746485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ce635-db2b-4a03-ac23-3ab6f0d71dec None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.747033 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ce635-db2b-4a03-ac23-3ab6f0d71dec None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.747183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ce635-db2b-4a03-ac23-3ab6f0d71dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.748324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ce635-db2b-4a03-ac23-3ab6f0d71dec None admin] RBAC: Adding query filter params (role.id=67447f88528849c59df641acc7768c92, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=d66e6f6ea62d439c87d9551286d29615) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:25.748709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ce635-db2b-4a03-ac23-3ab6f0d71dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:25.750323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ce635-db2b-4a03-ac23-3ab6f0d71dec None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:25.750918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a0865-cbc5-4f40-8537-dbd64b275393 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.756633 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 296/591] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/role_assignments?user.id=d66e6f6ea62d439c87d9551286d29615&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=67447f88528849c59df641acc7768c92 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:25.757554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ce635-db2b-4a03-ac23-3ab6f0d71dec None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.775198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.804045 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814b8f-83f2-401f-8675-8d4c93c07db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:25.805478 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814b8f-83f2-401f-8675-8d4c93c07db5 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:25.805930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814b8f-83f2-401f-8675-8d4c93c07db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:25.806410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814b8f-83f2-401f-8675-8d4c93c07db5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:25.822489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74814b8f-83f2-401f-8675-8d4c93c07db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-74814b8f-83f2-401f-8675-8d4c93c07db5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:25.829428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:25.830358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:00:25.831223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:25.834815 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 296/592] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:25.846983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814b8f-83f2-401f-8675-8d4c93c07db5 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:25.958376 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ce635-db2b-4a03-ac23-3ab6f0d71dec None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:25.964719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:25.973419 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814b8f-83f2-401f-8675-8d4c93c07db5 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.000225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691211f-30dc-4654-8151-dd28e2f028bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.000934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691211f-30dc-4654-8151-dd28e2f028bf None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.001160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691211f-30dc-4654-8151-dd28e2f028bf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.001435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691211f-30dc-4654-8151-dd28e2f028bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.002208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691211f-30dc-4654-8151-dd28e2f028bf None admin] RBAC: Adding query filter params (interface=public, service_id=3c7822a3f2b7431dbeda34bcb10b9463, region_id=RegionOne) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:26.002519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691211f-30dc-4654-8151-dd28e2f028bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.003990 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691211f-30dc-4654-8151-dd28e2f028bf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.012088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 297/593] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/endpoints?service_id=3c7822a3f2b7431dbeda34bcb10b9463&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:26.014085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691211f-30dc-4654-8151-dd28e2f028bf None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:26.024396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1d2b6-51eb-4a47-ae51-5bfd4262c420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.025939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1d2b6-51eb-4a47-ae51-5bfd4262c420 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.026300 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1d2b6-51eb-4a47-ae51-5bfd4262c420 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.026622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1d2b6-51eb-4a47-ae51-5bfd4262c420 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.027353 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1d2b6-51eb-4a47-ae51-5bfd4262c420 None admin] RBAC: Adding query filter params (name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:26.027718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1d2b6-51eb-4a47-ae51-5bfd4262c420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.029254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1d2b6-51eb-4a47-ae51-5bfd4262c420 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.038520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 297/594] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:00:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:26.039357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1d2b6-51eb-4a47-ae51-5bfd4262c420 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:26.108669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:26.132443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691211f-30dc-4654-8151-dd28e2f028bf None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.166915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1d2b6-51eb-4a47-ae51-5bfd4262c420 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.179079 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b49cff-b9e3-4309-916a-6b50e3e2d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.179998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b49cff-b9e3-4309-916a-6b50e3e2d272 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.180459 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b49cff-b9e3-4309-916a-6b50e3e2d272 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.180809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b49cff-b9e3-4309-916a-6b50e3e2d272 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.194666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b49cff-b9e3-4309-916a-6b50e3e2d272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-46b49cff-b9e3-4309-916a-6b50e3e2d272 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:26.202757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:26.203758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:26.204710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:26.208365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 298/595] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:26.209411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b49cff-b9e3-4309-916a-6b50e3e2d272 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:26.210359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dadcf-624e-4fa3-92c9-cd2c27e915a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.210989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dadcf-624e-4fa3-92c9-cd2c27e915a0 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.211267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dadcf-624e-4fa3-92c9-cd2c27e915a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.211540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dadcf-624e-4fa3-92c9-cd2c27e915a0 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.212162 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dadcf-624e-4fa3-92c9-cd2c27e915a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.213787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dadcf-624e-4fa3-92c9-cd2c27e915a0 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.215862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:26.221627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 298/596] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Oct 24 13:00:26 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:26.225110 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dadcf-624e-4fa3-92c9-cd2c27e915a0 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:26.373269 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b49cff-b9e3-4309-916a-6b50e3e2d272 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.448703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd9289-e360-46a9-93f9-9ac2e9542e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.448947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dadcf-624e-4fa3-92c9-cd2c27e915a0 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.449854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd9289-e360-46a9-93f9-9ac2e9542e69 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.450576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd9289-e360-46a9-93f9-9ac2e9542e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.451968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd9289-e360-46a9-93f9-9ac2e9542e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.461025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:26.467938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd9289-e360-46a9-93f9-9ac2e9542e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.469990 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd9289-e360-46a9-93f9-9ac2e9542e69 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c3fd9289-e360-46a9-93f9-9ac2e9542e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:26.490270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:26.491407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:26.492418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:26.492418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:26.492418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:26.492607 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4219-7107-42ae-bcb3-ffcfbf3766f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.493459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4219-7107-42ae-bcb3-ffcfbf3766f7 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.493973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4219-7107-42ae-bcb3-ffcfbf3766f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.494313 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4219-7107-42ae-bcb3-ffcfbf3766f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.495046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4219-7107-42ae-bcb3-ffcfbf3766f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:26.495409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4219-7107-42ae-bcb3-ffcfbf3766f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.495566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 299/597] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:26.500541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4219-7107-42ae-bcb3-ffcfbf3766f7 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.502548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd9289-e360-46a9-93f9-9ac2e9542e69 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:26.509760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 299/598] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:26.515821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4219-7107-42ae-bcb3-ffcfbf3766f7 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:26.612259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:26.666228 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd9289-e360-46a9-93f9-9ac2e9542e69 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.683947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4219-7107-42ae-bcb3-ffcfbf3766f7 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.715946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8aa2-3112-49b8-b314-1a92b1937135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.716610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8aa2-3112-49b8-b314-1a92b1937135 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.716885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8aa2-3112-49b8-b314-1a92b1937135 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.717162 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8aa2-3112-49b8-b314-1a92b1937135 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.717804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e8aa2-3112-49b8-b314-1a92b1937135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:26.718107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e8aa2-3112-49b8-b314-1a92b1937135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.719469 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e8aa2-3112-49b8-b314-1a92b1937135 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.733901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 300/599] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:26.739331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8aa2-3112-49b8-b314-1a92b1937135 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:26.784430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98371ff-0edd-41c5-ae4a-af24121594e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.786865 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98371ff-0edd-41c5-ae4a-af24121594e0 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.787142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98371ff-0edd-41c5-ae4a-af24121594e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.787411 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98371ff-0edd-41c5-ae4a-af24121594e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.800420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:26.825150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98371ff-0edd-41c5-ae4a-af24121594e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.826703 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98371ff-0edd-41c5-ae4a-af24121594e0 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.852311 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8aa2-3112-49b8-b314-1a92b1937135 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-e98371ff-0edd-41c5-ae4a-af24121594e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:26.869078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:26.870219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:26.871125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:26.871125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:26.871125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:26.871125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 300/600] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:26.877229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98371ff-0edd-41c5-ae4a-af24121594e0 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:26.893417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb3f50-2fb2-4dcf-9f30-6c00b1296754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:26.894246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb3f50-2fb2-4dcf-9f30-6c00b1296754 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:26.894780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb3f50-2fb2-4dcf-9f30-6c00b1296754 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:26.895117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb3f50-2fb2-4dcf-9f30-6c00b1296754 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:26.904194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb3f50-2fb2-4dcf-9f30-6c00b1296754 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:26.905752 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb3f50-2fb2-4dcf-9f30-6c00b1296754 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-84bb3f50-2fb2-4dcf-9f30-6c00b1296754 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:26.921135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:26.922175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:26.923140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 301/601] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Oct 24 13:00:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:26.928259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb3f50-2fb2-4dcf-9f30-6c00b1296754 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:27.026266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98371ff-0edd-41c5-ae4a-af24121594e0 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:27.039921 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:27.062758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb3f50-2fb2-4dcf-9f30-6c00b1296754 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:27.064111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff100b33-aedb-4d29-a886-36dd5d399a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:27.064871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100b33-aedb-4d29-a886-36dd5d399a75 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.065154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100b33-aedb-4d29-a886-36dd5d399a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.065426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100b33-aedb-4d29-a886-36dd5d399a75 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.066263 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff100b33-aedb-4d29-a886-36dd5d399a75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:27.066572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff100b33-aedb-4d29-a886-36dd5d399a75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:27.067956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff100b33-aedb-4d29-a886-36dd5d399a75 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:27.075918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:27.086647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 301/602] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:27.088081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5b561-b030-4664-97f3-24c168081f7c None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.088640 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5b561-b030-4664-97f3-24c168081f7c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.088924 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5b561-b030-4664-97f3-24c168081f7c None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.094337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 302/603] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:27.095428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5b561-b030-4664-97f3-24c168081f7c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:27.109306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b056e51-d9af-48ec-824f-8e0c49ffef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:27.109977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b056e51-d9af-48ec-824f-8e0c49ffef4a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.110282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b056e51-d9af-48ec-824f-8e0c49ffef4a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.110557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b056e51-d9af-48ec-824f-8e0c49ffef4a None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.111299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b056e51-d9af-48ec-824f-8e0c49ffef4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:27.111595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b056e51-d9af-48ec-824f-8e0c49ffef4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:27.113272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b056e51-d9af-48ec-824f-8e0c49ffef4a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:27.137610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 302/604] 10.222.0.15 () {56 vars in 1149 bytes} [Mon Oct 24 13:00:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:27.138967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943009-eb41-47c7-ba1c-6653a08c6ef5 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.139249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943009-eb41-47c7-ba1c-6653a08c6ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.139569 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943009-eb41-47c7-ba1c-6653a08c6ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.158914 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-26943009-eb41-47c7-ba1c-6653a08c6ef5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:27.160310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-26943009-eb41-47c7-ba1c-6653a08c6ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:27.204593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5b561-b030-4664-97f3-24c168081f7c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:27.230987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 303/605] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:27.231903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26943009-eb41-47c7-ba1c-6653a08c6ef5 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:27.256144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5e5e7-9247-485f-a35f-8778f072785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:27.256920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e5e7-9247-485f-a35f-8778f072785b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.257205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e5e7-9247-485f-a35f-8778f072785b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.257479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e5e7-9247-485f-a35f-8778f072785b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.273797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5e5e7-9247-485f-a35f-8778f072785b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:27.275401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5e5e7-9247-485f-a35f-8778f072785b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-e3c5e5e7-9247-485f-a35f-8778f072785b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:27.298285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:27.299298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:27.300283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:27.300283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:27.300283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:27.300283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:27.300283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:27.300283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:27.300283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:27.300283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:27.300283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 13:00:27.300283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:27.303473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 303/606] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:27.305513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5e5e7-9247-485f-a35f-8778f072785b None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:27.327415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:27.331517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26943009-eb41-47c7-ba1c-6653a08c6ef5 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:27.369497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db273e5-ec81-4470-b42a-3255d84881d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:27.370243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db273e5-ec81-4470-b42a-3255d84881d3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.371349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db273e5-ec81-4470-b42a-3255d84881d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.371730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db273e5-ec81-4470-b42a-3255d84881d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.388663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:27.495029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db273e5-ec81-4470-b42a-3255d84881d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:27.498198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db273e5-ec81-4470-b42a-3255d84881d3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:27.512171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5e5e7-9247-485f-a35f-8778f072785b None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:27.573482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1afec-3516-4c6d-ab3d-8ca6df24f0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:27.574099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1afec-3516-4c6d-ab3d-8ca6df24f0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.574375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1afec-3516-4c6d-ab3d-8ca6df24f0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.574641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1afec-3516-4c6d-ab3d-8ca6df24f0d5 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.575375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1afec-3516-4c6d-ab3d-8ca6df24f0d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:27.575677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1afec-3516-4c6d-ab3d-8ca6df24f0d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:27.578531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1afec-3516-4c6d-ab3d-8ca6df24f0d5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:27.609989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 304/607] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Oct 24 13:00:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:27.610849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1afec-3516-4c6d-ab3d-8ca6df24f0d5 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:27.660690 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:27.668772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 304/608] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:00:27.669735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db273e5-ec81-4470-b42a-3255d84881d3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:27.721606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:27.732948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1afec-3516-4c6d-ab3d-8ca6df24f0d5 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:27.770744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de3035-3e8b-4cb5-a81d-f327a40681a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:27.771307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de3035-3e8b-4cb5-a81d-f327a40681a7 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.771582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de3035-3e8b-4cb5-a81d-f327a40681a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.771851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de3035-3e8b-4cb5-a81d-f327a40681a7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.772276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db273e5-ec81-4470-b42a-3255d84881d3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:27.772485 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de3035-3e8b-4cb5-a81d-f327a40681a7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:27.773959 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de3035-3e8b-4cb5-a81d-f327a40681a7 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-f4de3035-3e8b-4cb5-a81d-f327a40681a7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:27.783651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:27.785960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 13:00:27.787863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:27.792428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 305/609] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Oct 24 13:00:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:27.792428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de3035-3e8b-4cb5-a81d-f327a40681a7 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:27.806771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b069a-609a-4454-a917-75055b3f12fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:27.807391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b069a-609a-4454-a917-75055b3f12fb None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.807663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b069a-609a-4454-a917-75055b3f12fb None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.807950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b069a-609a-4454-a917-75055b3f12fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.881591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:27.885105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b069a-609a-4454-a917-75055b3f12fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:27.886568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b069a-609a-4454-a917-75055b3f12fb None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:27.907357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de3035-3e8b-4cb5-a81d-f327a40681a7 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:27.944365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca68a14-c1ee-42e2-914a-29fe4b313b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:27.945275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca68a14-c1ee-42e2-914a-29fe4b313b06 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:27.945792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca68a14-c1ee-42e2-914a-29fe4b313b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:27.946218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca68a14-c1ee-42e2-914a-29fe4b313b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:27.957985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca68a14-c1ee-42e2-914a-29fe4b313b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:27.959759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca68a14-c1ee-42e2-914a-29fe4b313b06 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-8ca68a14-c1ee-42e2-914a-29fe4b313b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:27.975606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:27.976812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:27.977915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:27.977915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:27.977915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:27.979787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 306/610] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:27.980856 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca68a14-c1ee-42e2-914a-29fe4b313b06 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:27.993524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 305/611] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:00:27.993524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b069a-609a-4454-a917-75055b3f12fb None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:27.995433 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.088139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.091887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b069a-609a-4454-a917-75055b3f12fb None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.102373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca68a14-c1ee-42e2-914a-29fe4b313b06 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.129235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf1ea4-2660-4807-8d3a-6a423eb9b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.129850 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf1ea4-2660-4807-8d3a-6a423eb9b62e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.130146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf1ea4-2660-4807-8d3a-6a423eb9b62e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.130393 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf1ea4-2660-4807-8d3a-6a423eb9b62e None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.131205 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf1ea4-2660-4807-8d3a-6a423eb9b62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:28.131696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf1ea4-2660-4807-8d3a-6a423eb9b62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.132912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf1ea4-2660-4807-8d3a-6a423eb9b62e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.143027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb909-b959-4056-b07e-1e5871b53577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.143925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb909-b959-4056-b07e-1e5871b53577 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.144376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb909-b959-4056-b07e-1e5871b53577 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.144790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb909-b959-4056-b07e-1e5871b53577 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.145717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebb909-b959-4056-b07e-1e5871b53577 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:28.146173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebb909-b959-4056-b07e-1e5871b53577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.147770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebb909-b959-4056-b07e-1e5871b53577 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.148625 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 306/612] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:28.149486 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf1ea4-2660-4807-8d3a-6a423eb9b62e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.158239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 307/613] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Oct 24 13:00:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:28.159468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb909-b959-4056-b07e-1e5871b53577 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.234017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.258991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf1ea4-2660-4807-8d3a-6a423eb9b62e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.266968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb909-b959-4056-b07e-1e5871b53577 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.292589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4b0a3-7fcb-4e71-ab8c-d6195c4f1def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.293235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4b0a3-7fcb-4e71-ab8c-d6195c4f1def None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.293505 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4b0a3-7fcb-4e71-ab8c-d6195c4f1def None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.293780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4b0a3-7fcb-4e71-ab8c-d6195c4f1def None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.301228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656a5c7-2b4a-4969-9014-54f4bf18da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.301857 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656a5c7-2b4a-4969-9014-54f4bf18da88 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.302132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656a5c7-2b4a-4969-9014-54f4bf18da88 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.302404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656a5c7-2b4a-4969-9014-54f4bf18da88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.304984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4b0a3-7fcb-4e71-ab8c-d6195c4f1def None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.306553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4b0a3-7fcb-4e71-ab8c-d6195c4f1def None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.309311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656a5c7-2b4a-4969-9014-54f4bf18da88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.310805 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656a5c7-2b4a-4969-9014-54f4bf18da88 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-7ac4b0a3-7fcb-4e71-ab8c-d6195c4f1def None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:28.320985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:28.321970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:28.323442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:28.323442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:28.323442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:28.323442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 307/614] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:28.323442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4b0a3-7fcb-4e71-ab8c-d6195c4f1def None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-f656a5c7-2b4a-4969-9014-54f4bf18da88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:28.325820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:28.326731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:28.327632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:28.327632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:28.327632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:28.327632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:28.327632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:28.327632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:28.327632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:28.327632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:28.327632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 308/615] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:28.328226 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf467d-e299-4019-806e-2eade8716c8b None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.329194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf467d-e299-4019-806e-2eade8716c8b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.329477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf467d-e299-4019-806e-2eade8716c8b None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.336086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 309/616] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:28.336086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf467d-e299-4019-806e-2eade8716c8b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.344112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.435670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4b0a3-7fcb-4e71-ab8c-d6195c4f1def None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.442140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf467d-e299-4019-806e-2eade8716c8b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.473921 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.476261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aca830-95c6-493d-9fee-d5c598802071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.477113 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca830-95c6-493d-9fee-d5c598802071 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.477533 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca830-95c6-493d-9fee-d5c598802071 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.478044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca830-95c6-493d-9fee-d5c598802071 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.478909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aca830-95c6-493d-9fee-d5c598802071 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:28.479218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aca830-95c6-493d-9fee-d5c598802071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.480502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769c93f-8008-4d75-8d36-6cfcf33ed771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.480642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aca830-95c6-493d-9fee-d5c598802071 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.481141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769c93f-8008-4d75-8d36-6cfcf33ed771 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.481418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769c93f-8008-4d75-8d36-6cfcf33ed771 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.481675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769c93f-8008-4d75-8d36-6cfcf33ed771 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.482496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769c93f-8008-4d75-8d36-6cfcf33ed771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:28.483126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769c93f-8008-4d75-8d36-6cfcf33ed771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.484582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769c93f-8008-4d75-8d36-6cfcf33ed771 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.491408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 308/617] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:28.491408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798fb19-74f7-44bb-8451-ee67e54cbab4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.491408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798fb19-74f7-44bb-8451-ee67e54cbab4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.491408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798fb19-74f7-44bb-8451-ee67e54cbab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.502328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 310/618] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:28.502328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769c93f-8008-4d75-8d36-6cfcf33ed771 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.508246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a798fb19-74f7-44bb-8451-ee67e54cbab4 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:28.509488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a798fb19-74f7-44bb-8451-ee67e54cbab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:28.581681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 309/619] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:28.582025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798fb19-74f7-44bb-8451-ee67e54cbab4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.585916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.625074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769c93f-8008-4d75-8d36-6cfcf33ed771 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.666080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7706a-a6fc-4983-ae95-99b437f57d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.667072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7706a-a6fc-4983-ae95-99b437f57d1c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.667792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7706a-a6fc-4983-ae95-99b437f57d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.668255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7706a-a6fc-4983-ae95-99b437f57d1c None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.669672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7706a-a6fc-4983-ae95-99b437f57d1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:28.670266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7706a-a6fc-4983-ae95-99b437f57d1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.671900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7706a-a6fc-4983-ae95-99b437f57d1c None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.689512 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 311/620] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:28.689512 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7706a-a6fc-4983-ae95-99b437f57d1c None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.689756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798fb19-74f7-44bb-8451-ee67e54cbab4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.727591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d5f6a-6b03-40e6-b2f7-f0500acea63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.728201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d5f6a-6b03-40e6-b2f7-f0500acea63a None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.728603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d5f6a-6b03-40e6-b2f7-f0500acea63a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.728874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d5f6a-6b03-40e6-b2f7-f0500acea63a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.729539 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d5f6a-6b03-40e6-b2f7-f0500acea63a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.730899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d5f6a-6b03-40e6-b2f7-f0500acea63a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.735164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.757009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 310/621] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:00:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:28.758293 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86be890-9f45-400c-a2b3-6e0b550c2133 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.758576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86be890-9f45-400c-a2b3-6e0b550c2133 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.758845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86be890-9f45-400c-a2b3-6e0b550c2133 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.760349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 311/622] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:28.765578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86be890-9f45-400c-a2b3-6e0b550c2133 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:28.804453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7706a-a6fc-4983-ae95-99b437f57d1c None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.842401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:28.853935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cd216-250b-4804-8f10-0e408e77244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.854739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd216-250b-4804-8f10-0e408e77244b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.855123 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd216-250b-4804-8f10-0e408e77244b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.855513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd216-250b-4804-8f10-0e408e77244b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.864985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cd216-250b-4804-8f10-0e408e77244b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.866562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cd216-250b-4804-8f10-0e408e77244b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-fa6cd216-250b-4804-8f10-0e408e77244b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:28.881948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:28.882915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:28.883818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:28.883818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:28.883818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:28.883818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:28.883818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:28.883818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:28.883818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:28.883818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:28.883818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 312/623] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:28.890129 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d2a3-706e-4bdb-8eaf-50ac84a465fa None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.890411 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d2a3-706e-4bdb-8eaf-50ac84a465fa None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.890688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d2a3-706e-4bdb-8eaf-50ac84a465fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.895703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86be890-9f45-400c-a2b3-6e0b550c2133 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:28.912500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8fc9d2a3-706e-4bdb-8eaf-50ac84a465fa None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:28.913964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8fc9d2a3-706e-4bdb-8eaf-50ac84a465fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:28.933034 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e46b4f-a3c8-40f8-b1e0-84bbebf5b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:28.933717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e46b4f-a3c8-40f8-b1e0-84bbebf5b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:28.933998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e46b4f-a3c8-40f8-b1e0-84bbebf5b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:28.934268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e46b4f-a3c8-40f8-b1e0-84bbebf5b0b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:28.935030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e46b4f-a3c8-40f8-b1e0-84bbebf5b0b7 None admin] RBAC: Adding query filter params (role.id=44dc9e93541449b6b5f221c79be8b938, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=2ce014df3a294fa5bb209b40f889069f) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:28.935332 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e46b4f-a3c8-40f8-b1e0-84bbebf5b0b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:28.936823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e46b4f-a3c8-40f8-b1e0-84bbebf5b0b7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:28.952326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 312/624] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/role_assignments?user.id=2ce014df3a294fa5bb209b40f889069f&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=44dc9e93541449b6b5f221c79be8b938 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:28.952326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e46b4f-a3c8-40f8-b1e0-84bbebf5b0b7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.001760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 313/625] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:29.003607 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9d2a3-706e-4bdb-8eaf-50ac84a465fa None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.050407 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:29.088135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e46b4f-a3c8-40f8-b1e0-84bbebf5b0b7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.119064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:29.132925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9d2a3-706e-4bdb-8eaf-50ac84a465fa None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.133712 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaa2db-c72b-4488-a002-b6ad7473f107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.134621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaa2db-c72b-4488-a002-b6ad7473f107 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.134897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaa2db-c72b-4488-a002-b6ad7473f107 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.136099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaa2db-c72b-4488-a002-b6ad7473f107 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.136746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eaa2db-c72b-4488-a002-b6ad7473f107 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.138157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eaa2db-c72b-4488-a002-b6ad7473f107 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-71eaa2db-c72b-4488-a002-b6ad7473f107 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:29.151320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:29.152326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:29.153765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 313/626] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Oct 24 13:00:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:29.160131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaa2db-c72b-4488-a002-b6ad7473f107 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.174332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60502c21-a9db-4171-8e91-615800c436ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.175385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60502c21-a9db-4171-8e91-615800c436ff None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.175929 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60502c21-a9db-4171-8e91-615800c436ff None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.176557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60502c21-a9db-4171-8e91-615800c436ff None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.177540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60502c21-a9db-4171-8e91-615800c436ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:29.178047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60502c21-a9db-4171-8e91-615800c436ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.179854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60502c21-a9db-4171-8e91-615800c436ff None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.193095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 314/627] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:29.199994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60502c21-a9db-4171-8e91-615800c436ff None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.300351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaa2db-c72b-4488-a002-b6ad7473f107 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.329086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:29.335985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60502c21-a9db-4171-8e91-615800c436ff None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.354024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab433ae6-5200-49f0-af74-ffba31ccf850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.355116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433ae6-5200-49f0-af74-ffba31ccf850 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.355541 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433ae6-5200-49f0-af74-ffba31ccf850 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.356337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433ae6-5200-49f0-af74-ffba31ccf850 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.357141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab433ae6-5200-49f0-af74-ffba31ccf850 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:29.357592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab433ae6-5200-49f0-af74-ffba31ccf850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.359635 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab433ae6-5200-49f0-af74-ffba31ccf850 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.366827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 314/628] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:29.372379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab433ae6-5200-49f0-af74-ffba31ccf850 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.383320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad0a92-949c-4f06-90ac-d891d6790c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.385038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0a92-949c-4f06-90ac-d891d6790c48 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.385543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0a92-949c-4f06-90ac-d891d6790c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.386012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0a92-949c-4f06-90ac-d891d6790c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.387006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad0a92-949c-4f06-90ac-d891d6790c48 None admin] RBAC: Adding query filter params (role.id=67447f88528849c59df641acc7768c92, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=2e1fbb5f8a384aac98e17bd622e25eec) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:29.387573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad0a92-949c-4f06-90ac-d891d6790c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.389343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad0a92-949c-4f06-90ac-d891d6790c48 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.397912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 315/629] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/role_assignments?user.id=2e1fbb5f8a384aac98e17bd622e25eec&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=67447f88528849c59df641acc7768c92 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:29.399126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad0a92-949c-4f06-90ac-d891d6790c48 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.472858 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:29.581549 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad0a92-949c-4f06-90ac-d891d6790c48 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.587324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab433ae6-5200-49f0-af74-ffba31ccf850 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.634655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce1572-3064-4e7b-a873-1d658c1cef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.635224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce1572-3064-4e7b-a873-1d658c1cef4d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.635500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce1572-3064-4e7b-a873-1d658c1cef4d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.635765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce1572-3064-4e7b-a873-1d658c1cef4d None admin] PATH_INFO: `/v3/services/network` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.636672 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce1572-3064-4e7b-a873-1d658c1cef4d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.638299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce1572-3064-4e7b-a873-1d658c1cef4d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.641677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eaee0-d08b-42f7-8886-5f8d0a0a8539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.643144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaee0-d08b-42f7-8886-5f8d0a0a8539 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.643652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaee0-d08b-42f7-8886-5f8d0a0a8539 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.644161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaee0-d08b-42f7-8886-5f8d0a0a8539 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.645038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eaee0-d08b-42f7-8886-5f8d0a0a8539 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:29.645534 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eaee0-d08b-42f7-8886-5f8d0a0a8539 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.647170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eaee0-d08b-42f7-8886-5f8d0a0a8539 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-f9ce1572-3064-4e7b-a873-1d658c1cef4d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:29.648051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:29.649037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:29.649875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 315/630] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/services/network => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:29.655541 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce1572-3064-4e7b-a873-1d658c1cef4d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.658576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 316/631] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:29.780681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce1572-3064-4e7b-a873-1d658c1cef4d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:29.798193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:29.821426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987f30e-6dde-4679-afb3-7ea51c4207bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:29.822048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987f30e-6dde-4679-afb3-7ea51c4207bd None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:29.822323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987f30e-6dde-4679-afb3-7ea51c4207bd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:29.822594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987f30e-6dde-4679-afb3-7ea51c4207bd None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:29.823229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987f30e-6dde-4679-afb3-7ea51c4207bd None admin] RBAC: Adding query filter params (name=network) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:29.823526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987f30e-6dde-4679-afb3-7ea51c4207bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:29.824926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987f30e-6dde-4679-afb3-7ea51c4207bd None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:29.834241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 316/632] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:29.839778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eaee0-d08b-42f7-8886-5f8d0a0a8539 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:29.892600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:29.979392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eaee0-d08b-42f7-8886-5f8d0a0a8539 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:30.014107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fd9a1-cb84-4741-abdf-74fc43e9a6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:30.014783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fd9a1-cb84-4741-abdf-74fc43e9a6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:30.015064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fd9a1-cb84-4741-abdf-74fc43e9a6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:30.015335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fd9a1-cb84-4741-abdf-74fc43e9a6b8 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:30.016016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fd9a1-cb84-4741-abdf-74fc43e9a6b8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:30.016351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fd9a1-cb84-4741-abdf-74fc43e9a6b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:30.017738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fd9a1-cb84-4741-abdf-74fc43e9a6b8 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:30.022981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 317/633] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:30.028314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987f30e-6dde-4679-afb3-7ea51c4207bd None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:30.169935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987f30e-6dde-4679-afb3-7ea51c4207bd None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:30.204007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00684bf-b54b-4d81-a884-5cf30d775bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:30.204714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00684bf-b54b-4d81-a884-5cf30d775bad None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:30.204988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00684bf-b54b-4d81-a884-5cf30d775bad None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:30.205252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00684bf-b54b-4d81-a884-5cf30d775bad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:30.205915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00684bf-b54b-4d81-a884-5cf30d775bad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:30.207320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00684bf-b54b-4d81-a884-5cf30d775bad None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:30.231348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 317/634] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:00:30 2022] POST /identity/v3/endpoints => generated 337 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:31.372632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814428a-f5c5-4a9d-9b45-10b98c0c0dc7 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:31.373555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814428a-f5c5-4a9d-9b45-10b98c0c0dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:31.373555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814428a-f5c5-4a9d-9b45-10b98c0c0dc7 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:31.375029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 318/635] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:31.380573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e8cd4-3f01-40c1-9d25-56a45487634d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:31.381372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e8cd4-3f01-40c1-9d25-56a45487634d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:31.381864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e8cd4-3f01-40c1-9d25-56a45487634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:31.400617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-680e8cd4-3f01-40c1-9d25-56a45487634d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:31.402111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-680e8cd4-3f01-40c1-9d25-56a45487634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:31.431818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:31.448711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72990fb3-f316-4650-bdd5-4456de0792e1 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:31.449008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72990fb3-f316-4650-bdd5-4456de0792e1 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:31.449834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72990fb3-f316-4650-bdd5-4456de0792e1 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:31.450946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 319/636] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:31.456082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e247b9-75cb-401a-8575-3fc39ec2bbbc None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:31.456516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e247b9-75cb-401a-8575-3fc39ec2bbbc None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:31.456849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e247b9-75cb-401a-8575-3fc39ec2bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:31.476222 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-42e247b9-75cb-401a-8575-3fc39ec2bbbc None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:31.477571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-42e247b9-75cb-401a-8575-3fc39ec2bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:31.486442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 318/637] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:31.556420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 320/638] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:31.767534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e8cd4-3f01-40c1-9d25-56a45487634d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:31.827375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e247b9-75cb-401a-8575-3fc39ec2bbbc None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:31.856951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:31.895944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e8cd4-3f01-40c1-9d25-56a45487634d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:31.931093 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7350e0e-8a3f-4e51-bd94-094e43702090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:31.931935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7350e0e-8a3f-4e51-bd94-094e43702090 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:31.932330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7350e0e-8a3f-4e51-bd94-094e43702090 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:31.932700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7350e0e-8a3f-4e51-bd94-094e43702090 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:31.933805 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7350e0e-8a3f-4e51-bd94-094e43702090 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:31.935536 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7350e0e-8a3f-4e51-bd94-094e43702090 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:31.945775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e247b9-75cb-401a-8575-3fc39ec2bbbc None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c7350e0e-8a3f-4e51-bd94-094e43702090 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:31.946916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:31.948099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:00:31.949051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:31.949810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 319/639] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:31.960133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7350e0e-8a3f-4e51-bd94-094e43702090 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:31.986682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:31.989183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df9f81-73be-4685-893e-07b4fd010f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:31.989871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df9f81-73be-4685-893e-07b4fd010f9d None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:31.990242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df9f81-73be-4685-893e-07b4fd010f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:31.990442 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df9f81-73be-4685-893e-07b4fd010f9d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.004062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df9f81-73be-4685-893e-07b4fd010f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-03df9f81-73be-4685-893e-07b4fd010f9d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:32.009053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:32.010055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:32.011020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 321/640] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Oct 24 13:00:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:32.011729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcfca5-6d0e-4bf3-b09c-56132e513489 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.012797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcfca5-6d0e-4bf3-b09c-56132e513489 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.012797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcfca5-6d0e-4bf3-b09c-56132e513489 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.014281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 322/641] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:32.019243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcfca5-6d0e-4bf3-b09c-56132e513489 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.072487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7350e0e-8a3f-4e51-bd94-094e43702090 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.105712 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:32.108742 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632cbb8-fae9-47c3-8ed8-58430cfd0714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.109533 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632cbb8-fae9-47c3-8ed8-58430cfd0714 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.109817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632cbb8-fae9-47c3-8ed8-58430cfd0714 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.110124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632cbb8-fae9-47c3-8ed8-58430cfd0714 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.110751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632cbb8-fae9-47c3-8ed8-58430cfd0714 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:32.111047 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632cbb8-fae9-47c3-8ed8-58430cfd0714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.112461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632cbb8-fae9-47c3-8ed8-58430cfd0714 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.117210 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 320/642] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:32.118334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617408e3-33c8-4e0c-ae78-e1f9dc89e6a5 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.118608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617408e3-33c8-4e0c-ae78-e1f9dc89e6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.118876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617408e3-33c8-4e0c-ae78-e1f9dc89e6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.130992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcfca5-6d0e-4bf3-b09c-56132e513489 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.136628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-617408e3-33c8-4e0c-ae78-e1f9dc89e6a5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:32.137809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-617408e3-33c8-4e0c-ae78-e1f9dc89e6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:32.165079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f869630-6d71-485d-b30b-79092228619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.165695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f869630-6d71-485d-b30b-79092228619f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.165968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f869630-6d71-485d-b30b-79092228619f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.166241 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f869630-6d71-485d-b30b-79092228619f None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.166910 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f869630-6d71-485d-b30b-79092228619f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:32.167213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f869630-6d71-485d-b30b-79092228619f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.168603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f869630-6d71-485d-b30b-79092228619f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.181247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 323/643] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:32.181247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c92c5-951c-4cc8-ba56-ecd92b37225a None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.181247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c92c5-951c-4cc8-ba56-ecd92b37225a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.181247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c92c5-951c-4cc8-ba56-ecd92b37225a None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.181247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 324/644] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:32.181247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c92c5-951c-4cc8-ba56-ecd92b37225a None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.209825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 321/645] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:32.210657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617408e3-33c8-4e0c-ae78-e1f9dc89e6a5 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.236162 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:32.289065 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c92c5-951c-4cc8-ba56-ecd92b37225a None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.317676 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617408e3-33c8-4e0c-ae78-e1f9dc89e6a5 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.324202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cce8b7-580e-473c-9f75-23591c9bcd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.325527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cce8b7-580e-473c-9f75-23591c9bcd55 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.325949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cce8b7-580e-473c-9f75-23591c9bcd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.326367 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cce8b7-580e-473c-9f75-23591c9bcd55 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.327592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cce8b7-580e-473c-9f75-23591c9bcd55 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:32.328040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cce8b7-580e-473c-9f75-23591c9bcd55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.330260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cce8b7-580e-473c-9f75-23591c9bcd55 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.338285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 325/646] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:32.339676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22918798-2ae4-4f43-8dd8-20ccf0fb96d7 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.340019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22918798-2ae4-4f43-8dd8-20ccf0fb96d7 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.340386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22918798-2ae4-4f43-8dd8-20ccf0fb96d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.348221 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:32.363056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-22918798-2ae4-4f43-8dd8-20ccf0fb96d7 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:32.365012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-22918798-2ae4-4f43-8dd8-20ccf0fb96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:32.369720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fe2ed-90dd-411d-ae18-e21dc9c4bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.370820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fe2ed-90dd-411d-ae18-e21dc9c4bd5f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.371308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fe2ed-90dd-411d-ae18-e21dc9c4bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.371816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fe2ed-90dd-411d-ae18-e21dc9c4bd5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.384627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fe2ed-90dd-411d-ae18-e21dc9c4bd5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.387267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fe2ed-90dd-411d-ae18-e21dc9c4bd5f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-d89fe2ed-90dd-411d-ae18-e21dc9c4bd5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:32.404874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:32.405964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:32.406881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:32.406881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:32.406881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:32.414096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 322/647] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:32.415835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fe2ed-90dd-411d-ae18-e21dc9c4bd5f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.444339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 326/648] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:32.484907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22918798-2ae4-4f43-8dd8-20ccf0fb96d7 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.507558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:32.545915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fe2ed-90dd-411d-ae18-e21dc9c4bd5f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.584205 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621f1b7-db12-4f49-b2fb-a03069b9bc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.584975 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621f1b7-db12-4f49-b2fb-a03069b9bc9c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.585325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621f1b7-db12-4f49-b2fb-a03069b9bc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.585665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621f1b7-db12-4f49-b2fb-a03069b9bc9c None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.586320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621f1b7-db12-4f49-b2fb-a03069b9bc9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:32.586627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621f1b7-db12-4f49-b2fb-a03069b9bc9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.588011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621f1b7-db12-4f49-b2fb-a03069b9bc9c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.603311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22918798-2ae4-4f43-8dd8-20ccf0fb96d7 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.604990 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 323/649] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:32.606348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621f1b7-db12-4f49-b2fb-a03069b9bc9c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.645697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702f460-86b4-47cf-9a52-99c12d05bbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.646509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f460-86b4-47cf-9a52-99c12d05bbfb None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.646790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f460-86b4-47cf-9a52-99c12d05bbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.647064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f460-86b4-47cf-9a52-99c12d05bbfb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.648483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702f460-86b4-47cf-9a52-99c12d05bbfb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.649878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702f460-86b4-47cf-9a52-99c12d05bbfb None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.651696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-6702f460-86b4-47cf-9a52-99c12d05bbfb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:32.661550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:32.662565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:32.663468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:32.667820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 327/650] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:32.669408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702f460-86b4-47cf-9a52-99c12d05bbfb None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.721828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621f1b7-db12-4f49-b2fb-a03069b9bc9c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.751664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:32.757417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99ef5e-25aa-4847-a109-bd29a569cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.758058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99ef5e-25aa-4847-a109-bd29a569cef9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.758433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99ef5e-25aa-4847-a109-bd29a569cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.758715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99ef5e-25aa-4847-a109-bd29a569cef9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.766356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99ef5e-25aa-4847-a109-bd29a569cef9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.767833 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99ef5e-25aa-4847-a109-bd29a569cef9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-fe99ef5e-25aa-4847-a109-bd29a569cef9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:32.780330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:32.781294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:32.782233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 324/651] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:32.782924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99ef5e-25aa-4847-a109-bd29a569cef9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.785264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702f460-86b4-47cf-9a52-99c12d05bbfb None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.824576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c762-6be8-4af2-8366-77bf3909e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.825113 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c762-6be8-4af2-8366-77bf3909e073 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.825392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c762-6be8-4af2-8366-77bf3909e073 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.825675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c762-6be8-4af2-8366-77bf3909e073 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.826310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c762-6be8-4af2-8366-77bf3909e073 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:32.827016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c762-6be8-4af2-8366-77bf3909e073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.828428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c762-6be8-4af2-8366-77bf3909e073 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.833898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 328/652] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:32.837778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c762-6be8-4af2-8366-77bf3909e073 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:32.895082 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99ef5e-25aa-4847-a109-bd29a569cef9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.907189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:32.931657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cc52f-e029-43c9-9c8b-c115035810f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:32.932395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cc52f-e029-43c9-9c8b-c115035810f5 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:32.932728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cc52f-e029-43c9-9c8b-c115035810f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:32.933009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cc52f-e029-43c9-9c8b-c115035810f5 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:32.933664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cc52f-e029-43c9-9c8b-c115035810f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:32.935028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cc52f-e029-43c9-9c8b-c115035810f5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:32.948144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c762-6be8-4af2-8366-77bf3909e073 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:32.950099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 325/653] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:00:32 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:32.950903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cc52f-e029-43c9-9c8b-c115035810f5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.005985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02db1fa-1528-43df-8578-6a91a50e20f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.007793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02db1fa-1528-43df-8578-6a91a50e20f5 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.008326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02db1fa-1528-43df-8578-6a91a50e20f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.008836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02db1fa-1528-43df-8578-6a91a50e20f5 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.010291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02db1fa-1528-43df-8578-6a91a50e20f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:33.011264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02db1fa-1528-43df-8578-6a91a50e20f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:33.013472 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02db1fa-1528-43df-8578-6a91a50e20f5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.024141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:33.040092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 329/654] 10.222.0.15 () {56 vars in 1149 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:33.052376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02db1fa-1528-43df-8578-6a91a50e20f5 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.097442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cc52f-e029-43c9-9c8b-c115035810f5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:33.138184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9cd6b-18ab-4608-9d47-1113d162e926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.138883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9cd6b-18ab-4608-9d47-1113d162e926 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.139166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9cd6b-18ab-4608-9d47-1113d162e926 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.139442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9cd6b-18ab-4608-9d47-1113d162e926 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.141076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9cd6b-18ab-4608-9d47-1113d162e926 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:33.141209 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9cd6b-18ab-4608-9d47-1113d162e926 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:33.142553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9cd6b-18ab-4608-9d47-1113d162e926 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.156502 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 326/655] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:33.172184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02db1fa-1528-43df-8578-6a91a50e20f5 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:33.193079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:33.213070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aaaec-ef42-473d-8ac8-44c420dd2bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.213743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aaaec-ef42-473d-8ac8-44c420dd2bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.214020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aaaec-ef42-473d-8ac8-44c420dd2bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.214289 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aaaec-ef42-473d-8ac8-44c420dd2bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.226096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95aaaec-ef42-473d-8ac8-44c420dd2bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:33.227584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95aaaec-ef42-473d-8ac8-44c420dd2bf2 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-a95aaaec-ef42-473d-8ac8-44c420dd2bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:33.245057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:33.246077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:33.246976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:33.246976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:33.246976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:33.246976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 330/656] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:33.252757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9cd6b-18ab-4608-9d47-1113d162e926 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.363065 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9cd6b-18ab-4608-9d47-1113d162e926 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:33.379834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:33.407560 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b045f65-d935-442c-8066-c101ff9e9393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.409046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b045f65-d935-442c-8066-c101ff9e9393 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.409542 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b045f65-d935-442c-8066-c101ff9e9393 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.409981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b045f65-d935-442c-8066-c101ff9e9393 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.410775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b045f65-d935-442c-8066-c101ff9e9393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:33.411226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b045f65-d935-442c-8066-c101ff9e9393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:33.412789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b045f65-d935-442c-8066-c101ff9e9393 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.426392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 327/657] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:33.437295 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aaaec-ef42-473d-8ac8-44c420dd2bf2 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.568931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aaaec-ef42-473d-8ac8-44c420dd2bf2 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:33.603901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a8972-7261-4c27-b654-2b80e96fcc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.604829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8972-7261-4c27-b654-2b80e96fcc4e None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.605254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8972-7261-4c27-b654-2b80e96fcc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.605742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8972-7261-4c27-b654-2b80e96fcc4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.612967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a8972-7261-4c27-b654-2b80e96fcc4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:33.614746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a8972-7261-4c27-b654-2b80e96fcc4e None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-c12a8972-7261-4c27-b654-2b80e96fcc4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:33.626721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:33.627809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:33.628870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:33.628870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:33.628870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:33.628870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:33.628870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:33.628870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:33.628870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:33.628870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:33.630824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 331/658] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:33.637032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b045f65-d935-442c-8066-c101ff9e9393 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.750381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b045f65-d935-442c-8066-c101ff9e9393 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:33.789929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadac2a-ba2f-4ba0-8f15-21d198e524a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:33.791363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadac2a-ba2f-4ba0-8f15-21d198e524a4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:33.792501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadac2a-ba2f-4ba0-8f15-21d198e524a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:33.793202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadac2a-ba2f-4ba0-8f15-21d198e524a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:33.794291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadac2a-ba2f-4ba0-8f15-21d198e524a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:33.794986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadac2a-ba2f-4ba0-8f15-21d198e524a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:33.796856 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadac2a-ba2f-4ba0-8f15-21d198e524a4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:33.813461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 328/659] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:33.822358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a8972-7261-4c27-b654-2b80e96fcc4e None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:33.889939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:34.041738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a8972-7261-4c27-b654-2b80e96fcc4e None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:34.098637 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca4e94-6da9-48fa-b8b5-b506617a91dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:34.099873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca4e94-6da9-48fa-b8b5-b506617a91dd None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.100431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca4e94-6da9-48fa-b8b5-b506617a91dd None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.101046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca4e94-6da9-48fa-b8b5-b506617a91dd None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/2ce014df3a294fa5bb209b40f889069f/roles/f901b5b0f79d4ad290626ca5d21f9e10` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.109426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca4e94-6da9-48fa-b8b5-b506617a91dd None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=2ce014df3a294fa5bb209b40f889069f, role_id=f901b5b0f79d4ad290626ca5d21f9e10)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:34.113329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca4e94-6da9-48fa-b8b5-b506617a91dd None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:34.144484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 332/660] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:33 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/2ce014df3a294fa5bb209b40f889069f/roles/f901b5b0f79d4ad290626ca5d21f9e10 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:34.662356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8fed1-f973-4ac5-9ebe-371dcb666d3a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.662882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8fed1-f973-4ac5-9ebe-371dcb666d3a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.662882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8fed1-f973-4ac5-9ebe-371dcb666d3a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.664543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 329/661] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:34.669792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2192-0f71-48fe-9099-3894822b8654 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:34.670209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2192-0f71-48fe-9099-3894822b8654 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:34.670404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2192-0f71-48fe-9099-3894822b8654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:34.689270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ce2a2192-0f71-48fe-9099-3894822b8654 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:34.690522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ce2a2192-0f71-48fe-9099-3894822b8654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:34.760435 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 333/662] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:34 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:35.026340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8fed1-f973-4ac5-9ebe-371dcb666d3a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:35.066557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:35.133795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8fed1-f973-4ac5-9ebe-371dcb666d3a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:35.172622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5678161-32b9-4843-9b70-836c6b8b2341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:35.173353 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5678161-32b9-4843-9b70-836c6b8b2341 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:35.173634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5678161-32b9-4843-9b70-836c6b8b2341 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:35.173955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5678161-32b9-4843-9b70-836c6b8b2341 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:35.174614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5678161-32b9-4843-9b70-836c6b8b2341 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:35.176073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5678161-32b9-4843-9b70-836c6b8b2341 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:35.193054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 330/663] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:00:35 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:35.262018 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43da5-46e1-4c47-bd5a-c08dd178f83f None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:35.262367 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43da5-46e1-4c47-bd5a-c08dd178f83f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:35.262588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43da5-46e1-4c47-bd5a-c08dd178f83f None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:35.264349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 334/664] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:35.270782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873858a7-3f70-4c50-ba60-04c00f21256e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:35.271059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873858a7-3f70-4c50-ba60-04c00f21256e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:35.271339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873858a7-3f70-4c50-ba60-04c00f21256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:35.292592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-873858a7-3f70-4c50-ba60-04c00f21256e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:35.293826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-873858a7-3f70-4c50-ba60-04c00f21256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:35.376235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 331/665] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:35.524652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e0c0f-650d-4696-8a11-6263a353bbc0 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:35.524964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e0c0f-650d-4696-8a11-6263a353bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:35.525212 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e0c0f-650d-4696-8a11-6263a353bbc0 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:35.526804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 335/666] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:35.532123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ba8cd-e04f-44fc-97ae-f314ab4c9393 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:35.532465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ba8cd-e04f-44fc-97ae-f314ab4c9393 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:35.532733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ba8cd-e04f-44fc-97ae-f314ab4c9393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:35.551367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-910ba8cd-e04f-44fc-97ae-f314ab4c9393 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:35.552872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-910ba8cd-e04f-44fc-97ae-f314ab4c9393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:35.573965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:35.627321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 332/667] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:35.650729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e0c0f-650d-4696-8a11-6263a353bbc0 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:35.670818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:35.764502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e0c0f-650d-4696-8a11-6263a353bbc0 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:35.799803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fea9f4-c503-4145-aeca-bed80c4fba5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:35.800874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fea9f4-c503-4145-aeca-bed80c4fba5a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:35.801356 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fea9f4-c503-4145-aeca-bed80c4fba5a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:35.801921 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fea9f4-c503-4145-aeca-bed80c4fba5a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:35.802710 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fea9f4-c503-4145-aeca-bed80c4fba5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:35.804278 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fea9f4-c503-4145-aeca-bed80c4fba5a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-b7fea9f4-c503-4145-aeca-bed80c4fba5a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:35.813386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:35.814327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:00:35.815237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:35.822608 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 336/668] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Oct 24 13:00:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:35.825402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ba8cd-e04f-44fc-97ae-f314ab4c9393 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:35.927085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ba8cd-e04f-44fc-97ae-f314ab4c9393 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:35.939725 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fea9f4-c503-4145-aeca-bed80c4fba5a None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:35.969968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58df6bc-d365-4a73-94af-6507c66e479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:35.970594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58df6bc-d365-4a73-94af-6507c66e479f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:35.970877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58df6bc-d365-4a73-94af-6507c66e479f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:35.971152 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58df6bc-d365-4a73-94af-6507c66e479f None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:35.971981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58df6bc-d365-4a73-94af-6507c66e479f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:35.972310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58df6bc-d365-4a73-94af-6507c66e479f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:35.974309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58df6bc-d365-4a73-94af-6507c66e479f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:35.980340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 333/669] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:35.985919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58df6bc-d365-4a73-94af-6507c66e479f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:36.005063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:36.042127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:36.063672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fea9f4-c503-4145-aeca-bed80c4fba5a None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:36.101541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f8f3f-ef07-4301-a3b9-42da8165e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:36.103110 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f8f3f-ef07-4301-a3b9-42da8165e9f3 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.103593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f8f3f-ef07-4301-a3b9-42da8165e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.104018 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f8f3f-ef07-4301-a3b9-42da8165e9f3 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.104912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f8f3f-ef07-4301-a3b9-42da8165e9f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:36.105442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58df6bc-d365-4a73-94af-6507c66e479f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:36.106625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f8f3f-ef07-4301-a3b9-42da8165e9f3 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:36.132958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 337/670] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:00:35 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:36.162634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9c78f-1ad8-4a86-b2f4-b74cb3f7c214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:36.163539 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9c78f-1ad8-4a86-b2f4-b74cb3f7c214 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.163964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9c78f-1ad8-4a86-b2f4-b74cb3f7c214 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.164493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9c78f-1ad8-4a86-b2f4-b74cb3f7c214 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.165363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9c78f-1ad8-4a86-b2f4-b74cb3f7c214 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:36.165872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9c78f-1ad8-4a86-b2f4-b74cb3f7c214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:36.167464 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9c78f-1ad8-4a86-b2f4-b74cb3f7c214 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:36.174213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 334/671] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:36.180777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f8f3f-ef07-4301-a3b9-42da8165e9f3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:36.292325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f8f3f-ef07-4301-a3b9-42da8165e9f3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:36.333828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77449bc-8eeb-4803-b2c4-fdb5dbc8090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:36.334349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77449bc-8eeb-4803-b2c4-fdb5dbc8090b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.334631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77449bc-8eeb-4803-b2c4-fdb5dbc8090b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.334928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77449bc-8eeb-4803-b2c4-fdb5dbc8090b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.335659 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77449bc-8eeb-4803-b2c4-fdb5dbc8090b None admin] RBAC: Adding query filter params (interface=public, service_id=40ce36b7dc4e405681637a783cd18fa5, region_id=RegionOne) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:36.335958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77449bc-8eeb-4803-b2c4-fdb5dbc8090b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:36.337438 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77449bc-8eeb-4803-b2c4-fdb5dbc8090b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:36.348414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 338/672] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Oct 24 13:00:36 2022] GET /identity/v3/endpoints?service_id=40ce36b7dc4e405681637a783cd18fa5&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:36.350101 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9c78f-1ad8-4a86-b2f4-b74cb3f7c214 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:36.431586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:36.447374 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887519f-e93f-43b4-ab4c-f316c8620e53 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.448091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887519f-e93f-43b4-ab4c-f316c8620e53 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.448598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887519f-e93f-43b4-ab4c-f316c8620e53 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.450636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 339/673] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:36.455994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de751b7e-fafd-4168-847a-f927ffaa8a67 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.456238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9c78f-1ad8-4a86-b2f4-b74cb3f7c214 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:36.456826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de751b7e-fafd-4168-847a-f927ffaa8a67 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.457294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de751b7e-fafd-4168-847a-f927ffaa8a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.471580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:36.480062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-de751b7e-fafd-4168-847a-f927ffaa8a67 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:36.481946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-de751b7e-fafd-4168-847a-f927ffaa8a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:36.493931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2473afd-97fd-4ce4-b3a0-0ff2517480ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:36.494556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2473afd-97fd-4ce4-b3a0-0ff2517480ef None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.494837 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2473afd-97fd-4ce4-b3a0-0ff2517480ef None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.495113 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2473afd-97fd-4ce4-b3a0-0ff2517480ef None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.495729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2473afd-97fd-4ce4-b3a0-0ff2517480ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:36.497128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2473afd-97fd-4ce4-b3a0-0ff2517480ef None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:36.508391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 335/674] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Oct 24 13:00:36 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:00:36.562392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 340/675] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:36.837360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2473afd-97fd-4ce4-b3a0-0ff2517480ef None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:36.942621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2473afd-97fd-4ce4-b3a0-0ff2517480ef None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:36.979225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd684d4d-7bf4-4a51-8a8f-7baa0ca7e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:36.980224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd684d4d-7bf4-4a51-8a8f-7baa0ca7e513 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:36.980727 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd684d4d-7bf4-4a51-8a8f-7baa0ca7e513 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:36.981221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd684d4d-7bf4-4a51-8a8f-7baa0ca7e513 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:36.989556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:36.993862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd684d4d-7bf4-4a51-8a8f-7baa0ca7e513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-dd684d4d-7bf4-4a51-8a8f-7baa0ca7e513 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:37.000540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:37.001677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:00:37.002725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:37.005248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 336/676] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Oct 24 13:00:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:37.011452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de751b7e-fafd-4168-847a-f927ffaa8a67 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.114639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de751b7e-fafd-4168-847a-f927ffaa8a67 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.150580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00172f2e-4afc-4e0e-a497-01b4c7b80d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.151196 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00172f2e-4afc-4e0e-a497-01b4c7b80d34 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.151475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00172f2e-4afc-4e0e-a497-01b4c7b80d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.151746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00172f2e-4afc-4e0e-a497-01b4c7b80d34 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.152464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00172f2e-4afc-4e0e-a497-01b4c7b80d34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:37.152772 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00172f2e-4afc-4e0e-a497-01b4c7b80d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.154165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00172f2e-4afc-4e0e-a497-01b4c7b80d34 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.156399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.163159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 341/677] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:37.169258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd684d4d-7bf4-4a51-8a8f-7baa0ca7e513 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.273038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd684d4d-7bf4-4a51-8a8f-7baa0ca7e513 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.312839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0f54a-5dcc-4e75-965b-bf4c1cee7f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.313867 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0f54a-5dcc-4e75-965b-bf4c1cee7f25 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.314368 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0f54a-5dcc-4e75-965b-bf4c1cee7f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.314835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0f54a-5dcc-4e75-965b-bf4c1cee7f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.325914 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0f54a-5dcc-4e75-965b-bf4c1cee7f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.327601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0f54a-5dcc-4e75-965b-bf4c1cee7f25 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-85a0f54a-5dcc-4e75-965b-bf4c1cee7f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:37.342714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:37.343776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:37.344744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:37.344744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:37.344744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:37.346831 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 337/678] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:37.352766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00172f2e-4afc-4e0e-a497-01b4c7b80d34 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.412777 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177be1-3bad-4fbc-a4cd-ed2d68cd7c60 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.413425 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177be1-3bad-4fbc-a4cd-ed2d68cd7c60 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.413889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177be1-3bad-4fbc-a4cd-ed2d68cd7c60 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.415690 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 338/679] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:37.421433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599d1a2-d9b8-405e-959e-0ed5231f4cd4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.421971 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599d1a2-d9b8-405e-959e-0ed5231f4cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.422447 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599d1a2-d9b8-405e-959e-0ed5231f4cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.444136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3599d1a2-d9b8-405e-959e-0ed5231f4cd4 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:37.445377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3599d1a2-d9b8-405e-959e-0ed5231f4cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:37.457362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00172f2e-4afc-4e0e-a497-01b4c7b80d34 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.498425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540c68b-715b-45e9-8a80-59da73a554f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.499036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540c68b-715b-45e9-8a80-59da73a554f0 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.499672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540c68b-715b-45e9-8a80-59da73a554f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.499942 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540c68b-715b-45e9-8a80-59da73a554f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.500639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540c68b-715b-45e9-8a80-59da73a554f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:37.501249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540c68b-715b-45e9-8a80-59da73a554f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.502903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540c68b-715b-45e9-8a80-59da73a554f0 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.504766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.517679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 342/680] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:37.522999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540c68b-715b-45e9-8a80-59da73a554f0 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.538630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 339/681] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:37.584611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.625679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540c68b-715b-45e9-8a80-59da73a554f0 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.658315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e957611-62bc-46ea-b640-009883ecc90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.658941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e957611-62bc-46ea-b640-009883ecc90c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.659236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e957611-62bc-46ea-b640-009883ecc90c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.659509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e957611-62bc-46ea-b640-009883ecc90c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.666583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e957611-62bc-46ea-b640-009883ecc90c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.667974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e957611-62bc-46ea-b640-009883ecc90c None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-5e957611-62bc-46ea-b640-009883ecc90c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:37.679390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:37.680339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:37.681293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 343/682] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:37.689743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599d1a2-d9b8-405e-959e-0ed5231f4cd4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.795366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599d1a2-d9b8-405e-959e-0ed5231f4cd4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.814182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e957611-62bc-46ea-b640-009883ecc90c None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.834115 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b6be6-deb2-4039-9a84-e6eddb22aef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.835190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b6be6-deb2-4039-9a84-e6eddb22aef5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.835683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b6be6-deb2-4039-9a84-e6eddb22aef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.836211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b6be6-deb2-4039-9a84-e6eddb22aef5 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.837177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b6be6-deb2-4039-9a84-e6eddb22aef5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:37.837683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b6be6-deb2-4039-9a84-e6eddb22aef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.839913 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b6be6-deb2-4039-9a84-e6eddb22aef5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.866989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 340/683] 10.222.0.15 () {56 vars in 1149 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:37.868748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b6be6-deb2-4039-9a84-e6eddb22aef5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:37.913357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.928197 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e957611-62bc-46ea-b640-009883ecc90c None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.950576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:37.970869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e709c-42f4-4f9c-aac1-cb34f0503fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:37.971504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e709c-42f4-4f9c-aac1-cb34f0503fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:37.971853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e709c-42f4-4f9c-aac1-cb34f0503fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:37.972128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e709c-42f4-4f9c-aac1-cb34f0503fb1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:37.972748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e709c-42f4-4f9c-aac1-cb34f0503fb1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:37.974823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e709c-42f4-4f9c-aac1-cb34f0503fb1 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:37.980564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b6be6-deb2-4039-9a84-e6eddb22aef5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-835e709c-42f4-4f9c-aac1-cb34f0503fb1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:37.985476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:37.986466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:37.987335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 344/684] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:37.994760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e709c-42f4-4f9c-aac1-cb34f0503fb1 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.025691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ecff9-954f-4a45-a6aa-2af4b9b46cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.026661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ecff9-954f-4a45-a6aa-2af4b9b46cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.027219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ecff9-954f-4a45-a6aa-2af4b9b46cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.027800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ecff9-954f-4a45-a6aa-2af4b9b46cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.099421 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ecff9-954f-4a45-a6aa-2af4b9b46cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.101403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ecff9-954f-4a45-a6aa-2af4b9b46cf5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.110428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e709c-42f4-4f9c-aac1-cb34f0503fb1 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.146752 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.149795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952042c6-56d1-45bf-b992-ddaed13fb3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.150565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952042c6-56d1-45bf-b992-ddaed13fb3fb None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.151014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952042c6-56d1-45bf-b992-ddaed13fb3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.151479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952042c6-56d1-45bf-b992-ddaed13fb3fb None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.152322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952042c6-56d1-45bf-b992-ddaed13fb3fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:38.152945 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952042c6-56d1-45bf-b992-ddaed13fb3fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.155994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952042c6-56d1-45bf-b992-ddaed13fb3fb None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.161818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 345/685] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:38.167550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952042c6-56d1-45bf-b992-ddaed13fb3fb None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.219409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.225349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 341/686] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:00:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:00:38.230766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ecff9-954f-4a45-a6aa-2af4b9b46cf5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.286139 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952042c6-56d1-45bf-b992-ddaed13fb3fb None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.328250 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd93d82-9421-4787-853d-60d285ff799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.329062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93d82-9421-4787-853d-60d285ff799b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.329441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93d82-9421-4787-853d-60d285ff799b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.329813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93d82-9421-4787-853d-60d285ff799b None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.331288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93d82-9421-4787-853d-60d285ff799b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:38.331727 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93d82-9421-4787-853d-60d285ff799b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.333791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93d82-9421-4787-853d-60d285ff799b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.344107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 346/687] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:38.345258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd93d82-9421-4787-853d-60d285ff799b None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.359775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ecff9-954f-4a45-a6aa-2af4b9b46cf5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.408231 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d91f82-f13e-48a2-a4dd-9e5e9245ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.409154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91f82-f13e-48a2-a4dd-9e5e9245ecba None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.409466 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91f82-f13e-48a2-a4dd-9e5e9245ecba None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.409729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91f82-f13e-48a2-a4dd-9e5e9245ecba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.418333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.420675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d91f82-f13e-48a2-a4dd-9e5e9245ecba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.422146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d91f82-f13e-48a2-a4dd-9e5e9245ecba None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-e4d91f82-f13e-48a2-a4dd-9e5e9245ecba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:38.437340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:38.438315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:38.439900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:38.439900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:38.439900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:38.439900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 342/688] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:38.440129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56553f37-1493-4be4-8833-56fd939370ba None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.440443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56553f37-1493-4be4-8833-56fd939370ba None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.440640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56553f37-1493-4be4-8833-56fd939370ba None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.442023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 343/689] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:38.444118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56553f37-1493-4be4-8833-56fd939370ba None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.457008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd93d82-9421-4787-853d-60d285ff799b None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.468166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.494654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1981380-ace1-470e-8d37-569b80c9033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.495191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981380-ace1-470e-8d37-569b80c9033a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.495521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981380-ace1-470e-8d37-569b80c9033a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.495785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981380-ace1-470e-8d37-569b80c9033a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.496557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981380-ace1-470e-8d37-569b80c9033a None admin] RBAC: Adding query filter params (interface=public, service_id=41bd7372bc7f4da3b31384a7981bd5af, region_id=RegionOne) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:38.496889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981380-ace1-470e-8d37-569b80c9033a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.498619 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981380-ace1-470e-8d37-569b80c9033a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.508789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 347/690] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/endpoints?service_id=41bd7372bc7f4da3b31384a7981bd5af&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:38.508789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2544c-dcc7-4df2-998b-5810f3df7347 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.508789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2544c-dcc7-4df2-998b-5810f3df7347 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.508789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2544c-dcc7-4df2-998b-5810f3df7347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.525844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5dd2544c-dcc7-4df2-998b-5810f3df7347 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:38.527037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5dd2544c-dcc7-4df2-998b-5810f3df7347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:38.558952 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56553f37-1493-4be4-8833-56fd939370ba None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.593779 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac5e78-9bf9-4ed6-b9e3-b834939ae29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.594395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac5e78-9bf9-4ed6-b9e3-b834939ae29f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.594671 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac5e78-9bf9-4ed6-b9e3-b834939ae29f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.594941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac5e78-9bf9-4ed6-b9e3-b834939ae29f None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.595776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 348/691] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:38.595884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac5e78-9bf9-4ed6-b9e3-b834939ae29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:38.595884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac5e78-9bf9-4ed6-b9e3-b834939ae29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.597377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac5e78-9bf9-4ed6-b9e3-b834939ae29f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.601242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2544c-dcc7-4df2-998b-5810f3df7347 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.614465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 344/692] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:38.615431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac5e78-9bf9-4ed6-b9e3-b834939ae29f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.684530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.730514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2544c-dcc7-4df2-998b-5810f3df7347 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.733236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:38.749080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac5e78-9bf9-4ed6-b9e3-b834939ae29f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.775182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd17396-9faf-4826-9fa0-1b12d746d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.776369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd17396-9faf-4826-9fa0-1b12d746d187 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.777546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd17396-9faf-4826-9fa0-1b12d746d187 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.777831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd17396-9faf-4826-9fa0-1b12d746d187 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.778732 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd17396-9faf-4826-9fa0-1b12d746d187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.780600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd17396-9faf-4826-9fa0-1b12d746d187 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.787827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5bddc-02a1-4ea1-9a64-0d851cd84442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:38.788502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 349/693] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:00:38.789653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11411bd9-777b-48c3-95e2-5d509014098c None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.789944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11411bd9-777b-48c3-95e2-5d509014098c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.790213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11411bd9-777b-48c3-95e2-5d509014098c None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.791546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 350/694] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:38.793771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5bddc-02a1-4ea1-9a64-0d851cd84442 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.793771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5bddc-02a1-4ea1-9a64-0d851cd84442 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.793771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5bddc-02a1-4ea1-9a64-0d851cd84442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.797777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54219b9-8d05-4a3a-b807-e0ab5136dd31 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:38.798075 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54219b9-8d05-4a3a-b807-e0ab5136dd31 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:38.798345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54219b9-8d05-4a3a-b807-e0ab5136dd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:38.804198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5bddc-02a1-4ea1-9a64-0d851cd84442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:38.807822 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5bddc-02a1-4ea1-9a64-0d851cd84442 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:38.820489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b54219b9-8d05-4a3a-b807-e0ab5136dd31 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:38.821887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b54219b9-8d05-4a3a-b807-e0ab5136dd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-45d5bddc-02a1-4ea1-9a64-0d851cd84442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:38.822826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:38.823711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:38.824663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:38.824663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:38.824663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:38.824663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:38.824663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:38.824663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:38.824663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:38.824663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:38.831849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 345/695] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:38.832552 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5bddc-02a1-4ea1-9a64-0d851cd84442 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.926798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 351/696] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:38.928325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54219b9-8d05-4a3a-b807-e0ab5136dd31 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:38.959167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5bddc-02a1-4ea1-9a64-0d851cd84442 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:38.975786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.007455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7afc9-cfb9-495a-a016-ce0896d77038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.008059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7afc9-cfb9-495a-a016-ce0896d77038 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.008273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7afc9-cfb9-495a-a016-ce0896d77038 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.008683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7afc9-cfb9-495a-a016-ce0896d77038 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.009320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7afc9-cfb9-495a-a016-ce0896d77038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:39.009700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7afc9-cfb9-495a-a016-ce0896d77038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.011063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7afc9-cfb9-495a-a016-ce0896d77038 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.028330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 346/697] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:39.029864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7afc9-cfb9-495a-a016-ce0896d77038 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.060951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.066335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54219b9-8d05-4a3a-b807-e0ab5136dd31 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.103776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cab589-0713-4406-bbbe-65b46d3ddb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.104693 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab589-0713-4406-bbbe-65b46d3ddb8b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.105213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab589-0713-4406-bbbe-65b46d3ddb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.105625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab589-0713-4406-bbbe-65b46d3ddb8b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.106532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cab589-0713-4406-bbbe-65b46d3ddb8b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.108912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cab589-0713-4406-bbbe-65b46d3ddb8b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-b5cab589-0713-4406-bbbe-65b46d3ddb8b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:39.119434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:39.121111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:39.122159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:39.124683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 352/698] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:39.130492 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cab589-0713-4406-bbbe-65b46d3ddb8b None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.145686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7afc9-cfb9-495a-a016-ce0896d77038 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.183972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e5f9-d69e-44e8-8c27-14014ccbad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.185166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e5f9-d69e-44e8-8c27-14014ccbad91 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.185652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e5f9-d69e-44e8-8c27-14014ccbad91 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.186121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e5f9-d69e-44e8-8c27-14014ccbad91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.187041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6e5f9-d69e-44e8-8c27-14014ccbad91 None admin] RBAC: Adding query filter params (role.id=f901b5b0f79d4ad290626ca5d21f9e10, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=2ce014df3a294fa5bb209b40f889069f) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:39.187644 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6e5f9-d69e-44e8-8c27-14014ccbad91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.189429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6e5f9-d69e-44e8-8c27-14014ccbad91 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.196130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 347/699] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/role_assignments?user.id=2ce014df3a294fa5bb209b40f889069f&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=f901b5b0f79d4ad290626ca5d21f9e10 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:39.197227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e5f9-d69e-44e8-8c27-14014ccbad91 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.236836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.277441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cab589-0713-4406-bbbe-65b46d3ddb8b None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.312996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e5f9-d69e-44e8-8c27-14014ccbad91 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.327376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc200e-724d-4efd-9d51-46cd01875f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.328741 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc200e-724d-4efd-9d51-46cd01875f19 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.329175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc200e-724d-4efd-9d51-46cd01875f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.329863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc200e-724d-4efd-9d51-46cd01875f19 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.330711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc200e-724d-4efd-9d51-46cd01875f19 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:39.331225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc200e-724d-4efd-9d51-46cd01875f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.333385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc200e-724d-4efd-9d51-46cd01875f19 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.340766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 353/700] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:39.346489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc200e-724d-4efd-9d51-46cd01875f19 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.356658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95257b9-c3ea-477d-ac23-5a5d2c43ac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.357678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95257b9-c3ea-477d-ac23-5a5d2c43ac40 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.358116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95257b9-c3ea-477d-ac23-5a5d2c43ac40 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.358591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95257b9-c3ea-477d-ac23-5a5d2c43ac40 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.359474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95257b9-c3ea-477d-ac23-5a5d2c43ac40 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.361360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95257b9-c3ea-477d-ac23-5a5d2c43ac40 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-a95257b9-c3ea-477d-ac23-5a5d2c43ac40 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:39.372212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:39.373810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 13:00:39.374955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:39.382667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 348/701] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:39.383271 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.385054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95257b9-c3ea-477d-ac23-5a5d2c43ac40 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.472073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc200e-724d-4efd-9d51-46cd01875f19 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.507396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.511703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95257b9-c3ea-477d-ac23-5a5d2c43ac40 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.516882 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6651a-7c85-4a28-b5ad-45793891f349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.517718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6651a-7c85-4a28-b5ad-45793891f349 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.518144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6651a-7c85-4a28-b5ad-45793891f349 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.518596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6651a-7c85-4a28-b5ad-45793891f349 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.519384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6651a-7c85-4a28-b5ad-45793891f349 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:39.519829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6651a-7c85-4a28-b5ad-45793891f349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.521964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6651a-7c85-4a28-b5ad-45793891f349 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.529292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 354/702] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:39.536424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6651a-7c85-4a28-b5ad-45793891f349 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.559432 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d99260-607f-4a42-999e-1f4bfd5b7e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.560147 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d99260-607f-4a42-999e-1f4bfd5b7e0b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.560527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d99260-607f-4a42-999e-1f4bfd5b7e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.561109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d99260-607f-4a42-999e-1f4bfd5b7e0b None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.561835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d99260-607f-4a42-999e-1f4bfd5b7e0b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:39.562585 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d99260-607f-4a42-999e-1f4bfd5b7e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.564055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d99260-607f-4a42-999e-1f4bfd5b7e0b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.574911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 349/703] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:39.577035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d99260-607f-4a42-999e-1f4bfd5b7e0b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.644840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.656513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6651a-7c85-4a28-b5ad-45793891f349 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.691720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aff37-011d-42e0-819a-06e2d0d1dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.692431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aff37-011d-42e0-819a-06e2d0d1dae0 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.692732 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aff37-011d-42e0-819a-06e2d0d1dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.692997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aff37-011d-42e0-819a-06e2d0d1dae0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.693751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aff37-011d-42e0-819a-06e2d0d1dae0 None admin] RBAC: Adding query filter params (interface=public, service_id=2a0fb8f14e48495c8fa55e0bc33676f7, region_id=RegionOne) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:39.694066 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aff37-011d-42e0-819a-06e2d0d1dae0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.695468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aff37-011d-42e0-819a-06e2d0d1dae0 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.702273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d99260-607f-4a42-999e-1f4bfd5b7e0b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.704412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 355/704] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/endpoints?service_id=2a0fb8f14e48495c8fa55e0bc33676f7&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:39.707172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aff37-011d-42e0-819a-06e2d0d1dae0 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.742055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4b92d-025e-462a-aeaf-f347299c498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.743176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4b92d-025e-462a-aeaf-f347299c498b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.743702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4b92d-025e-462a-aeaf-f347299c498b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.744173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4b92d-025e-462a-aeaf-f347299c498b None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.745061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4b92d-025e-462a-aeaf-f347299c498b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:39.745684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4b92d-025e-462a-aeaf-f347299c498b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.747449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4b92d-025e-462a-aeaf-f347299c498b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.758199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 350/705] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:39.759803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4b92d-025e-462a-aeaf-f347299c498b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:39.796831 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:39.816587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aff37-011d-42e0-819a-06e2d0d1dae0 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.859928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb0fa8-6b41-42a9-8aa6-d8ec918fb402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.860572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0fa8-6b41-42a9-8aa6-d8ec918fb402 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.860855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0fa8-6b41-42a9-8aa6-d8ec918fb402 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.861130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0fa8-6b41-42a9-8aa6-d8ec918fb402 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.861822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb0fa8-6b41-42a9-8aa6-d8ec918fb402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.863176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb0fa8-6b41-42a9-8aa6-d8ec918fb402 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.867816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4b92d-025e-462a-aeaf-f347299c498b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:39.876776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 356/706] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Oct 24 13:00:39 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:00:39.907141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5c43c-dba4-4ea3-978e-1cff28a0ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:39.908208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5c43c-dba4-4ea3-978e-1cff28a0ba71 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:39.908722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5c43c-dba4-4ea3-978e-1cff28a0ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:39.909263 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5c43c-dba4-4ea3-978e-1cff28a0ba71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:39.910208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5c43c-dba4-4ea3-978e-1cff28a0ba71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:39.911869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5c43c-dba4-4ea3-978e-1cff28a0ba71 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:39.944535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 351/707] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:00:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:40.995020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04800c-5285-4a6d-a45b-91be4b76caff None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:40.995552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04800c-5285-4a6d-a45b-91be4b76caff None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:40.995552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04800c-5285-4a6d-a45b-91be4b76caff None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:40.997067 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 357/708] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:41.003290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f083-3ac5-4435-aac8-4e726e8a6135 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:41.004187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f083-3ac5-4435-aac8-4e726e8a6135 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:41.004717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f083-3ac5-4435-aac8-4e726e8a6135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:41.024463 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2a91f083-3ac5-4435-aac8-4e726e8a6135 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:41.025955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2a91f083-3ac5-4435-aac8-4e726e8a6135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:41.099560 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 352/709] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:41.367892 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04800c-5285-4a6d-a45b-91be4b76caff None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:41.389338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:41.403734 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e54e8-8f20-4ab0-9fd8-2b3e431547f1 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:41.404020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e54e8-8f20-4ab0-9fd8-2b3e431547f1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:41.404313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e54e8-8f20-4ab0-9fd8-2b3e431547f1 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:41.405918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 353/710] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:41.410743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa46d0-89a0-461c-a1bc-8c385dd91245 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:41.411027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa46d0-89a0-461c-a1bc-8c385dd91245 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:41.411301 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa46d0-89a0-461c-a1bc-8c385dd91245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:41.429909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5baa46d0-89a0-461c-a1bc-8c385dd91245 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:41.432267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5baa46d0-89a0-461c-a1bc-8c385dd91245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:41.436357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:41.477266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04800c-5285-4a6d-a45b-91be4b76caff None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:41.518849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c5d6c-b7cb-4ad2-8b1d-324d77eef75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:41.519586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c5d6c-b7cb-4ad2-8b1d-324d77eef75f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:41.519925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c5d6c-b7cb-4ad2-8b1d-324d77eef75f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:41.520259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c5d6c-b7cb-4ad2-8b1d-324d77eef75f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:41.520935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c5d6c-b7cb-4ad2-8b1d-324d77eef75f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:41.522450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c5d6c-b7cb-4ad2-8b1d-324d77eef75f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:41.522669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 354/711] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-1c4c5d6c-b7cb-4ad2-8b1d-324d77eef75f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:41.539993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:41.541038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 13:00:41.541890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:41.544682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 358/712] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:41.551184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa46d0-89a0-461c-a1bc-8c385dd91245 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:41.654732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa46d0-89a0-461c-a1bc-8c385dd91245 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:41.690262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a86afd-79e0-4cc3-af34-ec077e8d96d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:41.691401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a86afd-79e0-4cc3-af34-ec077e8d96d8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:41.691877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a86afd-79e0-4cc3-af34-ec077e8d96d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:41.692377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a86afd-79e0-4cc3-af34-ec077e8d96d8 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:41.693203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a86afd-79e0-4cc3-af34-ec077e8d96d8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:41.693697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a86afd-79e0-4cc3-af34-ec077e8d96d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:41.695278 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a86afd-79e0-4cc3-af34-ec077e8d96d8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:41.700631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 355/713] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:41.706662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c5d6c-b7cb-4ad2-8b1d-324d77eef75f None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:41.797610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:41.812029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a86afd-79e0-4cc3-af34-ec077e8d96d8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:41.816334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:41.817136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c5d6c-b7cb-4ad2-8b1d-324d77eef75f None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:41.856601 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cbe3f-060c-46b3-9174-922cedd818a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:41.857149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cbe3f-060c-46b3-9174-922cedd818a3 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:41.857432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cbe3f-060c-46b3-9174-922cedd818a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:41.857702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cbe3f-060c-46b3-9174-922cedd818a3 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:41.858335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cbe3f-060c-46b3-9174-922cedd818a3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:41.858649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cbe3f-060c-46b3-9174-922cedd818a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:41.860008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cbe3f-060c-46b3-9174-922cedd818a3 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:41.866467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 359/714] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Oct 24 13:00:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:41.872373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cbe3f-060c-46b3-9174-922cedd818a3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:41.935789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a86afd-79e0-4cc3-af34-ec077e8d96d8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:41.978962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee5003-51a8-4846-8b34-05ec8fc5b8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:41.979667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee5003-51a8-4846-8b34-05ec8fc5b8bd None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:41.979946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee5003-51a8-4846-8b34-05ec8fc5b8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:41.980225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee5003-51a8-4846-8b34-05ec8fc5b8bd None admin] PATH_INFO: `/v3/services/image` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:41.980876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee5003-51a8-4846-8b34-05ec8fc5b8bd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:41.983016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee5003-51a8-4846-8b34-05ec8fc5b8bd None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:41.990627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cbe3f-060c-46b3-9174-922cedd818a3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-5fee5003-51a8-4846-8b34-05ec8fc5b8bd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:41.995439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:41.996816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:41.998073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 356/715] 10.222.0.15 () {56 vars in 1105 bytes} [Mon Oct 24 13:00:41 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:42.005157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee5003-51a8-4846-8b34-05ec8fc5b8bd None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:42.039622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964c76-829a-4af3-aa3b-0a9b14cf76ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:42.040323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964c76-829a-4af3-aa3b-0a9b14cf76ac None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.040550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964c76-829a-4af3-aa3b-0a9b14cf76ac None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.040827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964c76-829a-4af3-aa3b-0a9b14cf76ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.041499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a964c76-829a-4af3-aa3b-0a9b14cf76ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:42.042861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a964c76-829a-4af3-aa3b-0a9b14cf76ac None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:42.075666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 360/716] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:00:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:42.086966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:42.109259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e93aa-22bb-4a9a-8286-dac7bebc46f2 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.109592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e93aa-22bb-4a9a-8286-dac7bebc46f2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.109829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e93aa-22bb-4a9a-8286-dac7bebc46f2 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.111544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 361/717] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:42.117428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e18f74-f70c-4e90-87df-884d95960e3d None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.117622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e18f74-f70c-4e90-87df-884d95960e3d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.117848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e18f74-f70c-4e90-87df-884d95960e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.124749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:42.133646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee5003-51a8-4846-8b34-05ec8fc5b8bd None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:42.140227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b0e18f74-f70c-4e90-87df-884d95960e3d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:42.141545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b0e18f74-f70c-4e90-87df-884d95960e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:42.187386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d21e5-1cea-46ef-93e8-c6447252ee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:42.188475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d21e5-1cea-46ef-93e8-c6447252ee61 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.188967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d21e5-1cea-46ef-93e8-c6447252ee61 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.189670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d21e5-1cea-46ef-93e8-c6447252ee61 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.191540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d21e5-1cea-46ef-93e8-c6447252ee61 None admin] RBAC: Adding query filter params (name=image) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:42.192077 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d21e5-1cea-46ef-93e8-c6447252ee61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:42.193786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d21e5-1cea-46ef-93e8-c6447252ee61 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:42.201057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 357/718] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:42.202666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb23b8-9b88-4b82-908a-2d489e0e29cf None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.202955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb23b8-9b88-4b82-908a-2d489e0e29cf None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.203224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb23b8-9b88-4b82-908a-2d489e0e29cf None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.204657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 358/719] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:42.209264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb23b8-9b88-4b82-908a-2d489e0e29cf None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:42.235720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 362/720] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:42.236847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d197e-a46f-4ffc-8f2f-b8325f0b9afa None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.237132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d197e-a46f-4ffc-8f2f-b8325f0b9afa None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.237638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d197e-a46f-4ffc-8f2f-b8325f0b9afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.256648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-306d197e-a46f-4ffc-8f2f-b8325f0b9afa None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:42.257830 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-306d197e-a46f-4ffc-8f2f-b8325f0b9afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:42.342315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb23b8-9b88-4b82-908a-2d489e0e29cf None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:42.343197 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 363/721] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:42.372512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:42.382715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ee214-d8c4-495d-b5dd-527c31556182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:42.383381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee214-d8c4-495d-b5dd-527c31556182 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.383659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee214-d8c4-495d-b5dd-527c31556182 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.383929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee214-d8c4-495d-b5dd-527c31556182 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.384578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ee214-d8c4-495d-b5dd-527c31556182 None admin] RBAC: Adding query filter params (type=image) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:42.384880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ee214-d8c4-495d-b5dd-527c31556182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:42.386311 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ee214-d8c4-495d-b5dd-527c31556182 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:42.391017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 359/722] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:42.521087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d197e-a46f-4ffc-8f2f-b8325f0b9afa None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:42.592699 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:42.611653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ee214-d8c4-495d-b5dd-527c31556182 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:42.640643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d197e-a46f-4ffc-8f2f-b8325f0b9afa None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:42.682335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455dea1-f59d-45ff-be46-b2543f7e883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:42.682994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455dea1-f59d-45ff-be46-b2543f7e883a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.683268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455dea1-f59d-45ff-be46-b2543f7e883a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.683538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455dea1-f59d-45ff-be46-b2543f7e883a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.684323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455dea1-f59d-45ff-be46-b2543f7e883a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:42.686425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455dea1-f59d-45ff-be46-b2543f7e883a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-f455dea1-f59d-45ff-be46-b2543f7e883a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:42.696526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:42.697522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:42.698354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 364/723] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:42.705168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455dea1-f59d-45ff-be46-b2543f7e883a None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:42.731793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ee214-d8c4-495d-b5dd-527c31556182 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:42.768329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00beb12-69cd-4436-bbc9-c63671b796d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:42.769214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00beb12-69cd-4436-bbc9-c63671b796d0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.769491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00beb12-69cd-4436-bbc9-c63671b796d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.769762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00beb12-69cd-4436-bbc9-c63671b796d0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.770352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00beb12-69cd-4436-bbc9-c63671b796d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:42.772053 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00beb12-69cd-4436-bbc9-c63671b796d0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-f00beb12-69cd-4436-bbc9-c63671b796d0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:42.781719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:42.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:42.785940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 360/724] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:42.789975 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00beb12-69cd-4436-bbc9-c63671b796d0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:42.822735 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455dea1-f59d-45ff-be46-b2543f7e883a None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:42.850684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:42.852797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:42.865881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d5cd9-75f2-4d9e-96b2-3cd1f90a4867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:42.867018 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d5cd9-75f2-4d9e-96b2-3cd1f90a4867 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.867320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d5cd9-75f2-4d9e-96b2-3cd1f90a4867 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.867594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d5cd9-75f2-4d9e-96b2-3cd1f90a4867 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.868242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d5cd9-75f2-4d9e-96b2-3cd1f90a4867 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:42.868581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d5cd9-75f2-4d9e-96b2-3cd1f90a4867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:42.870364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d5cd9-75f2-4d9e-96b2-3cd1f90a4867 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:42.876013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 365/725] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:42.885344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d5cd9-75f2-4d9e-96b2-3cd1f90a4867 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:42.907802 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00beb12-69cd-4436-bbc9-c63671b796d0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:42.953357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f196b5-7b14-4394-9427-37806e7ccadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:42.954609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f196b5-7b14-4394-9427-37806e7ccadc None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:42.955109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f196b5-7b14-4394-9427-37806e7ccadc None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:42.955636 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f196b5-7b14-4394-9427-37806e7ccadc None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:42.957002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f196b5-7b14-4394-9427-37806e7ccadc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:42.957510 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f196b5-7b14-4394-9427-37806e7ccadc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:42.959501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f196b5-7b14-4394-9427-37806e7ccadc None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:42.966331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 361/726] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:42.972971 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f196b5-7b14-4394-9427-37806e7ccadc None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:43.016462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d5cd9-75f2-4d9e-96b2-3cd1f90a4867 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:43.056371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8c71-f07c-45e8-8483-4a2fdb0bcbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:43.057187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8c71-f07c-45e8-8483-4a2fdb0bcbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.057474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8c71-f07c-45e8-8483-4a2fdb0bcbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.057749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8c71-f07c-45e8-8483-4a2fdb0bcbc1 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.058557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a8c71-f07c-45e8-8483-4a2fdb0bcbc1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:43.059617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a8c71-f07c-45e8-8483-4a2fdb0bcbc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:43.061056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a8c71-f07c-45e8-8483-4a2fdb0bcbc1 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:43.067373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 366/727] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:43.073179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8c71-f07c-45e8-8483-4a2fdb0bcbc1 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:43.095451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f196b5-7b14-4394-9427-37806e7ccadc None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:43.124853 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:43.138386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:43.138651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80177c-df99-4094-aef9-1ecde1dee338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:43.139679 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80177c-df99-4094-aef9-1ecde1dee338 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.139964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80177c-df99-4094-aef9-1ecde1dee338 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.140240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80177c-df99-4094-aef9-1ecde1dee338 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.140920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80177c-df99-4094-aef9-1ecde1dee338 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:43.141230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80177c-df99-4094-aef9-1ecde1dee338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:43.143356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80177c-df99-4094-aef9-1ecde1dee338 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:43.152367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 362/728] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:43.196826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8c71-f07c-45e8-8483-4a2fdb0bcbc1 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:43.234242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2616246-a310-46b8-8a15-976004bc62c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:43.235279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2616246-a310-46b8-8a15-976004bc62c5 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:43.235754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2616246-a310-46b8-8a15-976004bc62c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:43.236217 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2616246-a310-46b8-8a15-976004bc62c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:43.237205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2616246-a310-46b8-8a15-976004bc62c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:43.238960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2616246-a310-46b8-8a15-976004bc62c5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:43.262727 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 367/729] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:00:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:44.362882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8024b21-7690-4582-a92e-3210eb6c83f6 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.363423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8024b21-7690-4582-a92e-3210eb6c83f6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.363423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8024b21-7690-4582-a92e-3210eb6c83f6 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.365049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 363/730] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:44.370498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811c966-7b77-435d-9a3e-95d278c3070a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.370911 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811c966-7b77-435d-9a3e-95d278c3070a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.371084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811c966-7b77-435d-9a3e-95d278c3070a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.390084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a811c966-7b77-435d-9a3e-95d278c3070a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:44.391300 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a811c966-7b77-435d-9a3e-95d278c3070a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:44.467270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 368/731] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:44.675457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63297302-ddbd-4234-9e81-c3a1f65b959d None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.675457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63297302-ddbd-4234-9e81-c3a1f65b959d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.675457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63297302-ddbd-4234-9e81-c3a1f65b959d None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.676142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 364/732] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:44.681620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9be7b-0ce5-4a32-b0a0-0d2ab4540899 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.682118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9be7b-0ce5-4a32-b0a0-0d2ab4540899 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.682592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9be7b-0ce5-4a32-b0a0-0d2ab4540899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.701652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-0bc9be7b-0ce5-4a32-b0a0-0d2ab4540899 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:44.703128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0bc9be7b-0ce5-4a32-b0a0-0d2ab4540899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:44.732386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:44.733708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63297302-ddbd-4234-9e81-c3a1f65b959d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:44.781277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 369/733] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:44.852342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63297302-ddbd-4234-9e81-c3a1f65b959d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:44.888313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:44.888939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:44.889220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:44.889490 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:44.890202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:44.891687 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:44.894464 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING keystone.server.flask.common [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 24 13:00:44.914336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.sql.core [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 13:00:44.914336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:00:44.914336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [parameters: {'id': '839eac6f17c54b04b04a3c266fe39bf0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 13:00:44.914336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81637) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 839eac6f17c54b04b04a3c266fe39bf0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 839eac6f17c54b04b04a3c266fe39bf0. Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:00:44.932516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application result.read() Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 13:00:44.933667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application yield resource Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise self.value Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application session.commit() Oct 24 13:00:44.934951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:00:44.935874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:00:44.936872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application result.read() Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:00:44.937704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [parameters: {'id': '839eac6f17c54b04b04a3c266fe39bf0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:44.939997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:44.941939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:44.944035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:44.944035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 24 13:00:44.944035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 24 13:00:44.944035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:44.944035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:44.944035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 13:00:44.944035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 13:00:44.944035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 839eac6f17c54b04b04a3c266fe39bf0. Oct 24 13:00:44.944035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:44.944035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 365/734] 10.222.0.15 () {60 vars in 1140 bytes} [Mon Oct 24 13:00:44 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:44.952626 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9be7b-0ce5-4a32-b0a0-0d2ab4540899 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:45.044562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9be7b-0ce5-4a32-b0a0-0d2ab4540899 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:45.070272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:45.084733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e58d6a-5d83-4b0e-bd7e-4b6cdd95433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:45.085395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e58d6a-5d83-4b0e-bd7e-4b6cdd95433d None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.085770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e58d6a-5d83-4b0e-bd7e-4b6cdd95433d None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.086045 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e58d6a-5d83-4b0e-bd7e-4b6cdd95433d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.094281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e58d6a-5d83-4b0e-bd7e-4b6cdd95433d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:45.096040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e58d6a-5d83-4b0e-bd7e-4b6cdd95433d None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-17e58d6a-5d83-4b0e-bd7e-4b6cdd95433d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:45.108875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:45.109810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:45.110689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:45.110689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:45.110689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:45.110689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:45.110689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:45.110689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:45.110689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:45.110689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:45.110689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 370/735] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:45.116200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e58d6a-5d83-4b0e-bd7e-4b6cdd95433d None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:45.126428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:45.150497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:45.208379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f733e-c3b1-4259-a4d7-2b301302b6fe None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:45.229647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e58d6a-5d83-4b0e-bd7e-4b6cdd95433d None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:45.244841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d654d81-3be7-432e-a1ec-27d8b1e9ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:45.246062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654d81-3be7-432e-a1ec-27d8b1e9ecab None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.246626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654d81-3be7-432e-a1ec-27d8b1e9ecab None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.247246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654d81-3be7-432e-a1ec-27d8b1e9ecab None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.248482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d654d81-3be7-432e-a1ec-27d8b1e9ecab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:45.250363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d654d81-3be7-432e-a1ec-27d8b1e9ecab None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:45.265176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673acdb4-32d5-4c64-b74b-d03af5755437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:45.265837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673acdb4-32d5-4c64-b74b-d03af5755437 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.266272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673acdb4-32d5-4c64-b74b-d03af5755437 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.268051 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673acdb4-32d5-4c64-b74b-d03af5755437 None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.269046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673acdb4-32d5-4c64-b74b-d03af5755437 None admin] RBAC: Adding query filter params (name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:45.269357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673acdb4-32d5-4c64-b74b-d03af5755437 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:45.270854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673acdb4-32d5-4c64-b74b-d03af5755437 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:45.286540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 366/736] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:00:45 2022] POST /identity/v3/services => generated 242 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:45.295405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 371/737] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:45.428628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320ae7-a8b8-4632-8cb6-b31a15bfe37e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.429164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320ae7-a8b8-4632-8cb6-b31a15bfe37e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.429164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320ae7-a8b8-4632-8cb6-b31a15bfe37e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.430955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 367/738] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:45.437143 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843ae8-f8cd-4529-8843-31019ff33de6 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.437708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843ae8-f8cd-4529-8843-31019ff33de6 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.437708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843ae8-f8cd-4529-8843-31019ff33de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.442101 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e039-9a17-4e47-8e64-4d5683e0aa86 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.442444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e039-9a17-4e47-8e64-4d5683e0aa86 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.442652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e039-9a17-4e47-8e64-4d5683e0aa86 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.444541 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 368/739] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:45.450254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3567f-98ac-4d7e-b6db-52e5468fadad None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.450532 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3567f-98ac-4d7e-b6db-52e5468fadad None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.450807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3567f-98ac-4d7e-b6db-52e5468fadad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.461456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-13843ae8-f8cd-4529-8843-31019ff33de6 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:45.462999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-13843ae8-f8cd-4529-8843-31019ff33de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:45.471525 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a3c3567f-98ac-4d7e-b6db-52e5468fadad None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:45.473204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a3c3567f-98ac-4d7e-b6db-52e5468fadad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:45.567780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 372/740] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:45.571411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 369/741] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:45.833032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13843ae8-f8cd-4529-8843-31019ff33de6 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:45.851964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:45.856723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3567f-98ac-4d7e-b6db-52e5468fadad None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:45.886684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:45.943394 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13843ae8-f8cd-4529-8843-31019ff33de6 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:45.975498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3567f-98ac-4d7e-b6db-52e5468fadad None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:45.977391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d03c2-542b-4164-9aab-4335aa139fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:45.978012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d03c2-542b-4164-9aab-4335aa139fbc None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:45.978291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d03c2-542b-4164-9aab-4335aa139fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:45.978564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d03c2-542b-4164-9aab-4335aa139fbc None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:45.979231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d03c2-542b-4164-9aab-4335aa139fbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:45.980720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d03c2-542b-4164-9aab-4335aa139fbc None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:45.999893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 373/742] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:00:45 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:46.025083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3583c8d-5757-44d4-b450-a3bbd7818c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:46.025744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3583c8d-5757-44d4-b450-a3bbd7818c1b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:46.026023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3583c8d-5757-44d4-b450-a3bbd7818c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:46.026302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3583c8d-5757-44d4-b450-a3bbd7818c1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:46.026991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3583c8d-5757-44d4-b450-a3bbd7818c1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:46.028694 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3583c8d-5757-44d4-b450-a3bbd7818c1b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-d3583c8d-5757-44d4-b450-a3bbd7818c1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:46.039506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:46.040658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:46.041488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 370/743] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:46.047578 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d03c2-542b-4164-9aab-4335aa139fbc None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:46.131064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:46.172381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d03c2-542b-4164-9aab-4335aa139fbc None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:46.209016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f3af6-9e80-4a57-aebe-17ef72ba8d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:46.209649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f3af6-9e80-4a57-aebe-17ef72ba8d4f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:46.209928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f3af6-9e80-4a57-aebe-17ef72ba8d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:46.210202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f3af6-9e80-4a57-aebe-17ef72ba8d4f None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:46.210854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f3af6-9e80-4a57-aebe-17ef72ba8d4f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:46.211149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f3af6-9e80-4a57-aebe-17ef72ba8d4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:46.212592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f3af6-9e80-4a57-aebe-17ef72ba8d4f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:46.218082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 374/744] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:46.223646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3583c8d-5757-44d4-b450-a3bbd7818c1b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:46.318791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:46.334881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3583c8d-5757-44d4-b450-a3bbd7818c1b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:46.369546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b807e52-c75a-4c68-b1fe-c08915fa5ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:46.370163 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b807e52-c75a-4c68-b1fe-c08915fa5ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:46.370435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b807e52-c75a-4c68-b1fe-c08915fa5ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:46.370697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b807e52-c75a-4c68-b1fe-c08915fa5ac6 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:46.371319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b807e52-c75a-4c68-b1fe-c08915fa5ac6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:46.371616 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b807e52-c75a-4c68-b1fe-c08915fa5ac6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:46.373381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b807e52-c75a-4c68-b1fe-c08915fa5ac6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:46.378772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 371/745] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:46.384682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f3af6-9e80-4a57-aebe-17ef72ba8d4f None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:46.486504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f3af6-9e80-4a57-aebe-17ef72ba8d4f None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:46.521619 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051b5f9-babe-4f67-ae8b-b11a6bc8462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:46.522239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051b5f9-babe-4f67-ae8b-b11a6bc8462a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:46.522519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051b5f9-babe-4f67-ae8b-b11a6bc8462a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:46.522795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051b5f9-babe-4f67-ae8b-b11a6bc8462a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:46.523575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051b5f9-babe-4f67-ae8b-b11a6bc8462a None admin] RBAC: Adding query filter params (interface=admin, service_id=2a0fb8f14e48495c8fa55e0bc33676f7, region_id=RegionOne) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:46.523886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051b5f9-babe-4f67-ae8b-b11a6bc8462a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:46.525384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051b5f9-babe-4f67-ae8b-b11a6bc8462a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:46.527772 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:46.535676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 375/746] 10.222.0.15 () {56 vars in 1249 bytes} [Mon Oct 24 13:00:46 2022] GET /identity/v3/endpoints?service_id=2a0fb8f14e48495c8fa55e0bc33676f7&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:46.537348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b807e52-c75a-4c68-b1fe-c08915fa5ac6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:46.648665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b807e52-c75a-4c68-b1fe-c08915fa5ac6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:46.684344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba01093-c6a0-4053-8ac2-51616a3b9bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:46.685307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba01093-c6a0-4053-8ac2-51616a3b9bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:46.685754 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba01093-c6a0-4053-8ac2-51616a3b9bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:46.686245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba01093-c6a0-4053-8ac2-51616a3b9bf6 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:46.687060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba01093-c6a0-4053-8ac2-51616a3b9bf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:46.688638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba01093-c6a0-4053-8ac2-51616a3b9bf6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:46.695971 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 372/747] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Oct 24 13:00:46 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:00:47.554256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146186-579b-4eac-b2db-b85decb40f5b None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.555291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146186-579b-4eac-b2db-b85decb40f5b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.555771 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146186-579b-4eac-b2db-b85decb40f5b None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.557647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 376/748] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:47.563201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eef916-12b3-4646-ad7c-bf26e4a48187 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.564007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eef916-12b3-4646-ad7c-bf26e4a48187 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.564531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eef916-12b3-4646-ad7c-bf26e4a48187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.583885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-06eef916-12b3-4646-ad7c-bf26e4a48187 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:47.585559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-06eef916-12b3-4646-ad7c-bf26e4a48187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:47.597688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:47.606824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c8162-2f80-483b-a50a-88e0116861c1 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.607115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c8162-2f80-483b-a50a-88e0116861c1 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.607340 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c8162-2f80-483b-a50a-88e0116861c1 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.609470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 377/749] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:47.615049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d31b-8ba4-41c0-8138-a21655308709 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:47.615340 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d31b-8ba4-41c0-8138-a21655308709 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:47.615620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d31b-8ba4-41c0-8138-a21655308709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:47.635680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-69c9d31b-8ba4-41c0-8138-a21655308709 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:47.637140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-69c9d31b-8ba4-41c0-8138-a21655308709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:47.661042 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 373/750] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:47 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:47.711738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 378/751] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:47 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:47.931311 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eef916-12b3-4646-ad7c-bf26e4a48187 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:47.990860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d31b-8ba4-41c0-8138-a21655308709 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.033522 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eef916-12b3-4646-ad7c-bf26e4a48187 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.068254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ee7c-5a5d-4a52-b4c9-ed33d27f1fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.069309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ee7c-5a5d-4a52-b4c9-ed33d27f1fce None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.069808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ee7c-5a5d-4a52-b4c9-ed33d27f1fce None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.070277 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ee7c-5a5d-4a52-b4c9-ed33d27f1fce None admin] PATH_INFO: `/v3/services/image` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.071072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199ee7c-5a5d-4a52-b4c9-ed33d27f1fce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.072670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199ee7c-5a5d-4a52-b4c9-ed33d27f1fce None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-6199ee7c-5a5d-4a52-b4c9-ed33d27f1fce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:48.083203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:48.084220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:00:48.085094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:48.087800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 374/752] 10.222.0.15 () {56 vars in 1105 bytes} [Mon Oct 24 13:00:47 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:48.093903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ee7c-5a5d-4a52-b4c9-ed33d27f1fce None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.101314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d31b-8ba4-41c0-8138-a21655308709 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.105854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.131426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.138331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.138331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.138670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.138894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.139543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.141069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.143885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WARNING keystone.server.flask.common [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 24 13:00:48.160786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.sql.core [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 13:00:48.160786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 24 13:00:48.160786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [parameters: {'user_id': '0485451927914f1fbdd86184d5f2674b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 24 13:00:48.160786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81636) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result.read() Oct 24 13:00:48.168847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:00:48.169813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application yield resource Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise self.value Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application session.commit() Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:00:48.170765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:00:48.171675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:00:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result.read() Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:00:48.176405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [parameters: {'user_id': '0485451927914f1fbdd86184d5f2674b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:48.178309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 24 13:00:48.180130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 24 13:00:48.182321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 24 13:00:48.182321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 24 13:00:48.182321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:00:48.182321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:00:48.182321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 24 13:00:48.182321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:48.182321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 379/753] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Oct 24 13:00:47 2022] POST /identity/v3/users => generated 160 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:48.182321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.221866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ee7c-5a5d-4a52-b4c9-ed33d27f1fce None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.259189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f25f6a-8df1-46bf-8c53-3f9dd7a3811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.259912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25f6a-8df1-46bf-8c53-3f9dd7a3811c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.260193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25f6a-8df1-46bf-8c53-3f9dd7a3811c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.260491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25f6a-8df1-46bf-8c53-3f9dd7a3811c None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.261124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f25f6a-8df1-46bf-8c53-3f9dd7a3811c None admin] RBAC: Adding query filter params (name=image) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:48.261427 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f25f6a-8df1-46bf-8c53-3f9dd7a3811c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.262813 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f25f6a-8df1-46bf-8c53-3f9dd7a3811c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.267838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 375/754] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:48.272339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b33c5-daa9-40b1-894e-def8fc58aff8 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.272339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b33c5-daa9-40b1-894e-def8fc58aff8 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.272339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b33c5-daa9-40b1-894e-def8fc58aff8 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.272339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 376/755] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:48.277648 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b33c5-daa9-40b1-894e-def8fc58aff8 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.284948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d543c-4369-40a5-9b74-1af469bc762e None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.321208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faada3e-506c-4d69-bde4-8d6e0a113b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.321856 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faada3e-506c-4d69-bde4-8d6e0a113b77 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.322137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faada3e-506c-4d69-bde4-8d6e0a113b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.322407 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faada3e-506c-4d69-bde4-8d6e0a113b77 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.331036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faada3e-506c-4d69-bde4-8d6e0a113b77 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.332841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faada3e-506c-4d69-bde4-8d6e0a113b77 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-6faada3e-506c-4d69-bde4-8d6e0a113b77 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:48.345097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:48.346050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:48.347184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:48.347184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:48.347184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:48.347184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:48.347184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:48.347184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:48.347184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:48.347184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:48.347184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 13:00:48.347184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:48.347752 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.348464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 380/756] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:48.349942 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba3360-2f5d-4414-8dbd-53c5e2854214 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.350228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba3360-2f5d-4414-8dbd-53c5e2854214 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.350504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba3360-2f5d-4414-8dbd-53c5e2854214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.371967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-56ba3360-2f5d-4414-8dbd-53c5e2854214 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:48.373780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-56ba3360-2f5d-4414-8dbd-53c5e2854214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:48.386661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b33c5-daa9-40b1-894e-def8fc58aff8 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.423514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.426138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8968a0-a722-4142-be36-486fe16a3639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.426800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8968a0-a722-4142-be36-486fe16a3639 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.427031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8968a0-a722-4142-be36-486fe16a3639 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.427303 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8968a0-a722-4142-be36-486fe16a3639 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.427935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8968a0-a722-4142-be36-486fe16a3639 None admin] RBAC: Adding query filter params (type=image) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:48.428318 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8968a0-a722-4142-be36-486fe16a3639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.429637 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8968a0-a722-4142-be36-486fe16a3639 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.435041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 377/757] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:48.437643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8968a0-a722-4142-be36-486fe16a3639 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.446752 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 381/758] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:48 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:48.447667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba3360-2f5d-4414-8dbd-53c5e2854214 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.553559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8968a0-a722-4142-be36-486fe16a3639 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.566895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba3360-2f5d-4414-8dbd-53c5e2854214 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.590484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3fcf5-18c0-4200-8b8c-565070af2fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.592014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3fcf5-18c0-4200-8b8c-565070af2fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.592719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3fcf5-18c0-4200-8b8c-565070af2fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.593186 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3fcf5-18c0-4200-8b8c-565070af2fa5 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.594599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3fcf5-18c0-4200-8b8c-565070af2fa5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:48.595114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3fcf5-18c0-4200-8b8c-565070af2fa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.597614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3fcf5-18c0-4200-8b8c-565070af2fa5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.604118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62e3af-f4ed-427c-bb9f-239e76920cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.604801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e3af-f4ed-427c-bb9f-239e76920cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.605080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e3af-f4ed-427c-bb9f-239e76920cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.605355 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e3af-f4ed-427c-bb9f-239e76920cf3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.606063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62e3af-f4ed-427c-bb9f-239e76920cf3 None admin] RBAC: Adding query filter params (interface=public, service_id=83fa3633c2954441b0441b72feeb3409, region_id=RegionOne) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:48.606378 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62e3af-f4ed-427c-bb9f-239e76920cf3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.607746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62e3af-f4ed-427c-bb9f-239e76920cf3 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.611653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.616171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 382/759] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/endpoints?service_id=83fa3633c2954441b0441b72feeb3409&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:48.621672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62e3af-f4ed-427c-bb9f-239e76920cf3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.653223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 378/760] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:48.681139 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:48.727214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3fcf5-18c0-4200-8b8c-565070af2fa5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.745325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62e3af-f4ed-427c-bb9f-239e76920cf3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.787336 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244456b4-39e5-4581-a966-fa62b7c6bcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.788465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244456b4-39e5-4581-a966-fa62b7c6bcc4 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.789007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244456b4-39e5-4581-a966-fa62b7c6bcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.789482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244456b4-39e5-4581-a966-fa62b7c6bcc4 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.790410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244456b4-39e5-4581-a966-fa62b7c6bcc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.792165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244456b4-39e5-4581-a966-fa62b7c6bcc4 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.804781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 383/761] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/services => generated 1957 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:00:48.865421 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3fcf5-18c0-4200-8b8c-565070af2fa5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:48.904723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882bec-4b88-4fb9-aba5-c337e602f11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:48.905292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882bec-4b88-4fb9-aba5-c337e602f11f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.905564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882bec-4b88-4fb9-aba5-c337e602f11f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.905830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882bec-4b88-4fb9-aba5-c337e602f11f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.906422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882bec-4b88-4fb9-aba5-c337e602f11f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:48.907904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882bec-4b88-4fb9-aba5-c337e602f11f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-67882bec-4b88-4fb9-aba5-c337e602f11f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:48.917818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:48.918883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:48.919715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 379/762] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:48.922428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251819-0f08-4ee2-b664-ab305563324c None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.922721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251819-0f08-4ee2-b664-ab305563324c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.923001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251819-0f08-4ee2-b664-ab305563324c None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.924796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 384/763] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:48.927498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882bec-4b88-4fb9-aba5-c337e602f11f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:48.930412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324dfae-df2c-4ea6-aac7-9c9418c43fe3 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:48.930699 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324dfae-df2c-4ea6-aac7-9c9418c43fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:48.930976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324dfae-df2c-4ea6-aac7-9c9418c43fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:48.951290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b324dfae-df2c-4ea6-aac7-9c9418c43fe3 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:48.952579 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b324dfae-df2c-4ea6-aac7-9c9418c43fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:49.010058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.045843 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 385/764] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:48 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:49.058238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882bec-4b88-4fb9-aba5-c337e602f11f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.092110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f742da-ba04-4768-a6a7-a4abee7dd290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.092750 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f742da-ba04-4768-a6a7-a4abee7dd290 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.093031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f742da-ba04-4768-a6a7-a4abee7dd290 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.093302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f742da-ba04-4768-a6a7-a4abee7dd290 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.093929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f742da-ba04-4768-a6a7-a4abee7dd290 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.094230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f742da-ba04-4768-a6a7-a4abee7dd290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.095615 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f742da-ba04-4768-a6a7-a4abee7dd290 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.105164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 380/765] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:49.106804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324dfae-df2c-4ea6-aac7-9c9418c43fe3 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.153111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.212340 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324dfae-df2c-4ea6-aac7-9c9418c43fe3 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.245841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1d5d4-2028-41da-9a8f-eeb1a0c00093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.246450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1d5d4-2028-41da-9a8f-eeb1a0c00093 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.246724 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1d5d4-2028-41da-9a8f-eeb1a0c00093 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.246992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1d5d4-2028-41da-9a8f-eeb1a0c00093 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.247992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1d5d4-2028-41da-9a8f-eeb1a0c00093 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.248315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1d5d4-2028-41da-9a8f-eeb1a0c00093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.249705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1d5d4-2028-41da-9a8f-eeb1a0c00093 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.254881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 386/766] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:49.260549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f742da-ba04-4768-a6a7-a4abee7dd290 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.305379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1d5d4-2028-41da-9a8f-eeb1a0c00093 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.365964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f742da-ba04-4768-a6a7-a4abee7dd290 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.391262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.404189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5a676-e421-4a44-a375-8269657187bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.404662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1d5d4-2028-41da-9a8f-eeb1a0c00093 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.404835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5a676-e421-4a44-a375-8269657187bb None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.405097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5a676-e421-4a44-a375-8269657187bb None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.405363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5a676-e421-4a44-a375-8269657187bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.406056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5a676-e421-4a44-a375-8269657187bb None admin] RBAC: Adding query filter params (interface=public, service_id=d2d2bcafda25452699c53c9d4d63b910, region_id=RegionOne) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.406359 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5a676-e421-4a44-a375-8269657187bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.407232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.407734 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5a676-e421-4a44-a375-8269657187bb None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.417886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 381/767] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/endpoints?service_id=d2d2bcafda25452699c53c9d4d63b910&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:49.418895 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5a676-e421-4a44-a375-8269657187bb None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.445327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a2ab-4558-45f8-9bc6-e9c9e7014132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.445958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a2ab-4558-45f8-9bc6-e9c9e7014132 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.446234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a2ab-4558-45f8-9bc6-e9c9e7014132 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.446502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a2ab-4558-45f8-9bc6-e9c9e7014132 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.447091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0a2ab-4558-45f8-9bc6-e9c9e7014132 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.448482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0a2ab-4558-45f8-9bc6-e9c9e7014132 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-a5c0a2ab-4558-45f8-9bc6-e9c9e7014132 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:49.457318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:49.458309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 13:00:49.459227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:49.463382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 387/768] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:49.464163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a2ab-4558-45f8-9bc6-e9c9e7014132 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.523153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5a676-e421-4a44-a375-8269657187bb None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.556812 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edabc0-81e9-409c-8099-6dac2711ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.557424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edabc0-81e9-409c-8099-6dac2711ba59 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.557700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edabc0-81e9-409c-8099-6dac2711ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.557970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edabc0-81e9-409c-8099-6dac2711ba59 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.558574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edabc0-81e9-409c-8099-6dac2711ba59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.559955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edabc0-81e9-409c-8099-6dac2711ba59 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.566517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 382/769] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:00:49.570562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a2ab-4558-45f8-9bc6-e9c9e7014132 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.612985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89507a-3fb6-45f4-96b8-79eb1e5c8bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.613612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89507a-3fb6-45f4-96b8-79eb1e5c8bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.613870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89507a-3fb6-45f4-96b8-79eb1e5c8bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.614164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89507a-3fb6-45f4-96b8-79eb1e5c8bd7 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.614811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89507a-3fb6-45f4-96b8-79eb1e5c8bd7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.615110 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89507a-3fb6-45f4-96b8-79eb1e5c8bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.616532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89507a-3fb6-45f4-96b8-79eb1e5c8bd7 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.622385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 388/770] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:49.628704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edabc0-81e9-409c-8099-6dac2711ba59 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.689711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.750205 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edabc0-81e9-409c-8099-6dac2711ba59 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.786920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670f1a7-888e-461d-98bb-03425ca05288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.787575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670f1a7-888e-461d-98bb-03425ca05288 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.787857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670f1a7-888e-461d-98bb-03425ca05288 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.788259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670f1a7-888e-461d-98bb-03425ca05288 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.788817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670f1a7-888e-461d-98bb-03425ca05288 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:49.789107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670f1a7-888e-461d-98bb-03425ca05288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.790767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670f1a7-888e-461d-98bb-03425ca05288 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.796074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 383/771] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Oct 24 13:00:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:49.802084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89507a-3fb6-45f4-96b8-79eb1e5c8bd7 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:49.839352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:49.915661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89507a-3fb6-45f4-96b8-79eb1e5c8bd7 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:49.949104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfaeb1-230e-4edb-98c5-bc4139760bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:49.949726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfaeb1-230e-4edb-98c5-bc4139760bfe None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:49.949998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfaeb1-230e-4edb-98c5-bc4139760bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:49.950271 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfaeb1-230e-4edb-98c5-bc4139760bfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:49.950952 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfaeb1-230e-4edb-98c5-bc4139760bfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:49.952379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfaeb1-230e-4edb-98c5-bc4139760bfe None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:49.969603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 389/772] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:00:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:00:50.971962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273eb93-c58f-4c1c-9073-a4b598be78fc None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.972548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273eb93-c58f-4c1c-9073-a4b598be78fc None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.972548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273eb93-c58f-4c1c-9073-a4b598be78fc None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.974030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 384/773] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:50.979272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e1b0-dfb0-422f-a393-0c547a5cce0f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:50.979691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e1b0-dfb0-422f-a393-0c547a5cce0f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:50.979781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e1b0-dfb0-422f-a393-0c547a5cce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:50.998627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4038e1b0-dfb0-422f-a393-0c547a5cce0f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:50.999798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4038e1b0-dfb0-422f-a393-0c547a5cce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:51.073717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 390/774] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:50 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:51.330672 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273eb93-c58f-4c1c-9073-a4b598be78fc None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.437983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273eb93-c58f-4c1c-9073-a4b598be78fc None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.452202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:51.475437 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084dc94-2a60-4f28-94dd-21261b8258f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.476076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084dc94-2a60-4f28-94dd-21261b8258f2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.476388 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084dc94-2a60-4f28-94dd-21261b8258f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.476662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084dc94-2a60-4f28-94dd-21261b8258f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.477308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084dc94-2a60-4f28-94dd-21261b8258f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.478722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084dc94-2a60-4f28-94dd-21261b8258f2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-0084dc94-2a60-4f28-94dd-21261b8258f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:51.487618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:51.488620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:51.493324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 385/775] 10.222.0.15 () {56 vars in 1105 bytes} [Mon Oct 24 13:00:51 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:51.495469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e1b0-dfb0-422f-a393-0c547a5cce0f None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.515311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:51.602625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e1b0-dfb0-422f-a393-0c547a5cce0f None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.641436 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11767b-1ae3-4078-9d2b-84e152d74388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.642059 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11767b-1ae3-4078-9d2b-84e152d74388 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.642326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11767b-1ae3-4078-9d2b-84e152d74388 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.642590 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11767b-1ae3-4078-9d2b-84e152d74388 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.643294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11767b-1ae3-4078-9d2b-84e152d74388 None admin] RBAC: Adding query filter params (name=image) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:51.643595 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11767b-1ae3-4078-9d2b-84e152d74388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.644987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11767b-1ae3-4078-9d2b-84e152d74388 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.654704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 391/776] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:51.656010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084dc94-2a60-4f28-94dd-21261b8258f2 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.721145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367278d6-b4c4-4fe4-b0eb-d43156cc517b None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.721440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367278d6-b4c4-4fe4-b0eb-d43156cc517b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.721690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367278d6-b4c4-4fe4-b0eb-d43156cc517b None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.723286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 392/777] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:51.728554 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae6f0-f07c-4563-b307-6b8222358f72 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.728836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae6f0-f07c-4563-b307-6b8222358f72 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.729104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae6f0-f07c-4563-b307-6b8222358f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.748662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a42ae6f0-f07c-4563-b307-6b8222358f72 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:51.749844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a42ae6f0-f07c-4563-b307-6b8222358f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:51.766576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084dc94-2a60-4f28-94dd-21261b8258f2 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.803158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6924a34-1390-475f-846e-d3a3d86f9a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.803866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6924a34-1390-475f-846e-d3a3d86f9a5c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.804141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6924a34-1390-475f-846e-d3a3d86f9a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.804443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6924a34-1390-475f-846e-d3a3d86f9a5c None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.805075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6924a34-1390-475f-846e-d3a3d86f9a5c None admin] RBAC: Adding query filter params (type=image) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:51.805366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6924a34-1390-475f-846e-d3a3d86f9a5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.806856 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6924a34-1390-475f-846e-d3a3d86f9a5c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.812398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 386/778] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:51.818169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6924a34-1390-475f-846e-d3a3d86f9a5c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:51.819788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 393/779] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:51 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:51.870190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:51.927436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6924a34-1390-475f-846e-d3a3d86f9a5c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:51.962777 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410285e-1a57-4a21-aada-58a818a221b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:51.963393 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410285e-1a57-4a21-aada-58a818a221b9 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:51.963656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410285e-1a57-4a21-aada-58a818a221b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:51.963922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410285e-1a57-4a21-aada-58a818a221b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:51.964619 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410285e-1a57-4a21-aada-58a818a221b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:51.965994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410285e-1a57-4a21-aada-58a818a221b9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:51.992322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 387/780] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:00:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:52.084014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ae6f0-f07c-4563-b307-6b8222358f72 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:52.100239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:52.140929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8b62-a67d-4e4f-9580-0eb78d886567 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.141328 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8b62-a67d-4e4f-9580-0eb78d886567 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.141732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8b62-a67d-4e4f-9580-0eb78d886567 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.144342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 388/781] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:52.150015 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c468e-7201-4ee7-9deb-9d88132b4410 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.150571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c468e-7201-4ee7-9deb-9d88132b4410 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.150844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c468e-7201-4ee7-9deb-9d88132b4410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.177430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-316c468e-7201-4ee7-9deb-9d88132b4410 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:52.178650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-316c468e-7201-4ee7-9deb-9d88132b4410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:52.198777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ae6f0-f07c-4563-b307-6b8222358f72 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:52.246839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7781ba-11ba-4ecc-899b-a6c42e826e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:52.247487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7781ba-11ba-4ecc-899b-a6c42e826e67 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.248129 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7781ba-11ba-4ecc-899b-a6c42e826e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.248429 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7781ba-11ba-4ecc-899b-a6c42e826e67 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.249013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7781ba-11ba-4ecc-899b-a6c42e826e67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:52.250381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7781ba-11ba-4ecc-899b-a6c42e826e67 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:52.256916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 389/782] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:52 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-3a7781ba-11ba-4ecc-899b-a6c42e826e67 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:52.259629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:52.260603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:52.261596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 394/783] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:52.266825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c468e-7201-4ee7-9deb-9d88132b4410 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:52.294832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:52.370202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c468e-7201-4ee7-9deb-9d88132b4410 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:52.406224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b80b5-4119-43d0-a857-df33f04e0064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:52.406838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b80b5-4119-43d0-a857-df33f04e0064 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.407138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b80b5-4119-43d0-a857-df33f04e0064 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.407386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b80b5-4119-43d0-a857-df33f04e0064 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.408012 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b80b5-4119-43d0-a857-df33f04e0064 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:52.408323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b80b5-4119-43d0-a857-df33f04e0064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:52.409772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b80b5-4119-43d0-a857-df33f04e0064 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:52.415053 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 390/784] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:52.420607 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7781ba-11ba-4ecc-899b-a6c42e826e67 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:52.489297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:52.524659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b80b5-4119-43d0-a857-df33f04e0064 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:52.525389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7781ba-11ba-4ecc-899b-a6c42e826e67 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:52.561141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6264a84-129d-4bbb-8a6a-2e2e304b3d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:52.561754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6264a84-129d-4bbb-8a6a-2e2e304b3d22 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.562033 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6264a84-129d-4bbb-8a6a-2e2e304b3d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.562314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6264a84-129d-4bbb-8a6a-2e2e304b3d22 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.562948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6264a84-129d-4bbb-8a6a-2e2e304b3d22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:52.563247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6264a84-129d-4bbb-8a6a-2e2e304b3d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:52.564650 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6264a84-129d-4bbb-8a6a-2e2e304b3d22 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:52.569775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 395/785] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Oct 24 13:00:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:52.575206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6264a84-129d-4bbb-8a6a-2e2e304b3d22 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:52.616086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:52.626108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b80b5-4119-43d0-a857-df33f04e0064 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:52.659279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0e97-4de2-4cf8-8dba-a0bc92e67cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:52.659841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0e97-4de2-4cf8-8dba-a0bc92e67cde None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.660181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0e97-4de2-4cf8-8dba-a0bc92e67cde None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.660426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0e97-4de2-4cf8-8dba-a0bc92e67cde None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.661522 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed0e97-4de2-4cf8-8dba-a0bc92e67cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:52.662963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed0e97-4de2-4cf8-8dba-a0bc92e67cde None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:52.668453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 391/786] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:52.670722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0e97-4de2-4cf8-8dba-a0bc92e67cde None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:52.680119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6264a84-129d-4bbb-8a6a-2e2e304b3d22 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:52.717522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47411be3-f6fc-4817-b689-a320073d6422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:52.718143 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411be3-f6fc-4817-b689-a320073d6422 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.718463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411be3-f6fc-4817-b689-a320073d6422 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.718695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411be3-f6fc-4817-b689-a320073d6422 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.719377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47411be3-f6fc-4817-b689-a320073d6422 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:52.720786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47411be3-f6fc-4817-b689-a320073d6422 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:52.726416 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:52.743774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 396/787] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:00:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:52.788070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0e97-4de2-4cf8-8dba-a0bc92e67cde None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:52.832826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6e37e-46a3-4b12-8ae8-8dba1b3d176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:52.833454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e37e-46a3-4b12-8ae8-8dba1b3d176d None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:52.833731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e37e-46a3-4b12-8ae8-8dba1b3d176d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:52.834016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e37e-46a3-4b12-8ae8-8dba1b3d176d None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:52.834673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6e37e-46a3-4b12-8ae8-8dba1b3d176d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:52.836132 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6e37e-46a3-4b12-8ae8-8dba1b3d176d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:52.871758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 392/788] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:00:52 2022] POST /identity/v3/projects => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:54.169441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ccb32-1454-4a7f-b3a5-4a4f8bd828ab None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.170030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ccb32-1454-4a7f-b3a5-4a4f8bd828ab None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.170030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ccb32-1454-4a7f-b3a5-4a4f8bd828ab None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.171508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 397/789] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:54.176690 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750528cd-e275-41ae-8bcf-43297ec13cd9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.177127 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750528cd-e275-41ae-8bcf-43297ec13cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.177270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750528cd-e275-41ae-8bcf-43297ec13cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.196496 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-750528cd-e275-41ae-8bcf-43297ec13cd9 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:54.197701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-750528cd-e275-41ae-8bcf-43297ec13cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:54.199771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:54.270019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 393/790] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:54.532796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ccb32-1454-4a7f-b3a5-4a4f8bd828ab None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:54.639954 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ccb32-1454-4a7f-b3a5-4a4f8bd828ab None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:54.674338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee58e0-52b4-44f1-8697-42c30ce3ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:54.674935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee58e0-52b4-44f1-8697-42c30ce3ed8a None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.675235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee58e0-52b4-44f1-8697-42c30ce3ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.675509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee58e0-52b4-44f1-8697-42c30ce3ed8a None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.676191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee58e0-52b4-44f1-8697-42c30ce3ed8a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:54.677599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee58e0-52b4-44f1-8697-42c30ce3ed8a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:54.685847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.sql.core [None req-1cee58e0-52b4-44f1-8697-42c30ce3ed8a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:00:54.685847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:00:54.685847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [parameters: {'id': '8b5dc913aff842048fc1262b9cb1d1df', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 13:00:54.685847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81636) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-1cee58e0-52b4-44f1-8697-42c30ce3ed8a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:00:54.693349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result.read() Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 13:00:54.694176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application yield resource Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application next(self.gen) Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise self.value Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application session.commit() Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 13:00:54.695184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.session.flush() Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application compat.raise_( Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 13:00:54.696101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 13:00:54.697627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application conn.query(q) Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application result.read() Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 13:00:54.698424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [parameters: {'id': '8b5dc913aff842048fc1262b9cb1d1df', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 13:00:54.703555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:54.704586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:54.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 398/791] 10.222.0.15 () {60 vars in 1137 bytes} [Mon Oct 24 13:00:54 2022] POST /identity/v3/domains => generated 190 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:54.706830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750528cd-e275-41ae-8bcf-43297ec13cd9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:54.806313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750528cd-e275-41ae-8bcf-43297ec13cd9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:54.840395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf85472-9ee4-4da5-a3ef-9a43b9d0a562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:54.843609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf85472-9ee4-4da5-a3ef-9a43b9d0a562 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.843609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf85472-9ee4-4da5-a3ef-9a43b9d0a562 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.843609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf85472-9ee4-4da5-a3ef-9a43b9d0a562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.854408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:54.861526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf85472-9ee4-4da5-a3ef-9a43b9d0a562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:54.863118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf85472-9ee4-4da5-a3ef-9a43b9d0a562 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-8cf85472-9ee4-4da5-a3ef-9a43b9d0a562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:54.881111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:54.882160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:54.883050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:54.883050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:54.883050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:54.884659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 394/792] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:54.888409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee58e0-52b4-44f1-8697-42c30ce3ed8a None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:54.952351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:54.973381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa075e-41d9-4295-90e7-88f8bb273fda None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.973698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa075e-41d9-4295-90e7-88f8bb273fda None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.973934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa075e-41d9-4295-90e7-88f8bb273fda None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.975417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 395/793] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:00:54.980095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a10a9-1059-492c-b314-6ef004fdf2f5 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:54.980400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a10a9-1059-492c-b314-6ef004fdf2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:54.980688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a10a9-1059-492c-b314-6ef004fdf2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:54.999427 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b54a10a9-1059-492c-b314-6ef004fdf2f5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:55.000540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee58e0-52b4-44f1-8697-42c30ce3ed8a None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.000667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b54a10a9-1059-492c-b314-6ef004fdf2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:55.036634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0260c16-d061-4646-92fa-632039235529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.037711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260c16-d061-4646-92fa-632039235529 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.037711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260c16-d061-4646-92fa-632039235529 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.037918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260c16-d061-4646-92fa-632039235529 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.038440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0260c16-d061-4646-92fa-632039235529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:55.038747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0260c16-d061-4646-92fa-632039235529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.040203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0260c16-d061-4646-92fa-632039235529 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.052469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 399/794] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:55.053663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224cb39-59b7-4521-ba52-fd3155bf059e None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.053953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224cb39-59b7-4521-ba52-fd3155bf059e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.054230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224cb39-59b7-4521-ba52-fd3155bf059e None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.055451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 400/795] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:55.062516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6062004-1ca9-40cb-b999-55d479ae91dd None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.062716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6062004-1ca9-40cb-b999-55d479ae91dd None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.062986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6062004-1ca9-40cb-b999-55d479ae91dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.070611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 396/796] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:55.084759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d6062004-1ca9-40cb-b999-55d479ae91dd None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:55.086071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d6062004-1ca9-40cb-b999-55d479ae91dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:55.161048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 401/797] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:55.330821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a10a9-1059-492c-b314-6ef004fdf2f5 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.426606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6062004-1ca9-40cb-b999-55d479ae91dd None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.427138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a10a9-1059-492c-b314-6ef004fdf2f5 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.446349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.462531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea333ef9-2ee9-4b95-9240-01b6249361cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.463165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea333ef9-2ee9-4b95-9240-01b6249361cd None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.463438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea333ef9-2ee9-4b95-9240-01b6249361cd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.463703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea333ef9-2ee9-4b95-9240-01b6249361cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.473058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.473673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea333ef9-2ee9-4b95-9240-01b6249361cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-ea333ef9-2ee9-4b95-9240-01b6249361cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:55.478682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:55.479626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:55.480493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 397/798] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:55.485900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea333ef9-2ee9-4b95-9240-01b6249361cd None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.527718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6062004-1ca9-40cb-b999-55d479ae91dd None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.563017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acd7a1-06ce-48e5-86e4-1624ee256720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.563649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acd7a1-06ce-48e5-86e4-1624ee256720 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.563923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acd7a1-06ce-48e5-86e4-1624ee256720 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.564190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acd7a1-06ce-48e5-86e4-1624ee256720 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.565392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acd7a1-06ce-48e5-86e4-1624ee256720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.566828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acd7a1-06ce-48e5-86e4-1624ee256720 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.568429 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 402/799] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:55.574137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acd7a1-06ce-48e5-86e4-1624ee256720 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.586551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea333ef9-2ee9-4b95-9240-01b6249361cd None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.620646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e06411-65f1-462f-a0dd-8f73753d5105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.621250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e06411-65f1-462f-a0dd-8f73753d5105 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.621530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e06411-65f1-462f-a0dd-8f73753d5105 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.621798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e06411-65f1-462f-a0dd-8f73753d5105 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.622877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e06411-65f1-462f-a0dd-8f73753d5105 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:55.623399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e06411-65f1-462f-a0dd-8f73753d5105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.624577 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e06411-65f1-462f-a0dd-8f73753d5105 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.632424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 398/800] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:00:55.638207 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e06411-65f1-462f-a0dd-8f73753d5105 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.673577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acd7a1-06ce-48e5-86e4-1624ee256720 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.678987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.687029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:55.707702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3368fd-46cb-4d58-9654-3d6d613cbbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.710742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3368fd-46cb-4d58-9654-3d6d613cbbe1 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.711048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3368fd-46cb-4d58-9654-3d6d613cbbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.711373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3368fd-46cb-4d58-9654-3d6d613cbbe1 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.713139 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3368fd-46cb-4d58-9654-3d6d613cbbe1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.714626 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3368fd-46cb-4d58-9654-3d6d613cbbe1 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.736443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e06411-65f1-462f-a0dd-8f73753d5105 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.737810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 403/801] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 13:00:55 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:00:55.773323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fc70b-8e64-469a-8f8c-785ad254867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.773991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fc70b-8e64-469a-8f8c-785ad254867e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.774270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fc70b-8e64-469a-8f8c-785ad254867e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.774542 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fc70b-8e64-469a-8f8c-785ad254867e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.786915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fc70b-8e64-469a-8f8c-785ad254867e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.788439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fc70b-8e64-469a-8f8c-785ad254867e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-254fc70b-8e64-469a-8f8c-785ad254867e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:55.804596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:55.805674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:55.806618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:55.806618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:55.806618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:55.806618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 399/802] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:00:55.811999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3368fd-46cb-4d58-9654-3d6d613cbbe1 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:55.926156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3368fd-46cb-4d58-9654-3d6d613cbbe1 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:55.961296 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4ebf-10eb-46b9-854c-916724f99627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:55.961909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4ebf-10eb-46b9-854c-916724f99627 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:55.962187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4ebf-10eb-46b9-854c-916724f99627 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:55.962454 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4ebf-10eb-46b9-854c-916724f99627 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:55.963098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4ebf-10eb-46b9-854c-916724f99627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:55.963400 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4ebf-10eb-46b9-854c-916724f99627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:55.964841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4ebf-10eb-46b9-854c-916724f99627 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:55.976643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 404/803] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:55.982546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fc70b-8e64-469a-8f8c-785ad254867e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.078363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.085934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fc70b-8e64-469a-8f8c-785ad254867e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.120166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2186ed-a003-4862-a47d-3f115bf6fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.120751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2186ed-a003-4862-a47d-3f115bf6fae8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.121028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2186ed-a003-4862-a47d-3f115bf6fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.121297 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2186ed-a003-4862-a47d-3f115bf6fae8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.129391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2186ed-a003-4862-a47d-3f115bf6fae8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.130845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2186ed-a003-4862-a47d-3f115bf6fae8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-7f2186ed-a003-4862-a47d-3f115bf6fae8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:00:56.141820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:56.142905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:56.144420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 400/804] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Oct 24 13:00:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:56.148964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4ebf-10eb-46b9-854c-916724f99627 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.179489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.253306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4ebf-10eb-46b9-854c-916724f99627 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.286405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe3301-2071-473b-b356-55e567ae7320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.287016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe3301-2071-473b-b356-55e567ae7320 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.287295 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe3301-2071-473b-b356-55e567ae7320 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.287565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe3301-2071-473b-b356-55e567ae7320 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.288322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe3301-2071-473b-b356-55e567ae7320 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:56.288640 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe3301-2071-473b-b356-55e567ae7320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.290077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe3301-2071-473b-b356-55e567ae7320 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.309195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 405/805] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:56.316318 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2186ed-a003-4862-a47d-3f115bf6fae8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.419601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2186ed-a003-4862-a47d-3f115bf6fae8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.454141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134aaba-3600-4634-bddf-71bae87a4fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.454780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134aaba-3600-4634-bddf-71bae87a4fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.455058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134aaba-3600-4634-bddf-71bae87a4fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.455324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134aaba-3600-4634-bddf-71bae87a4fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.466869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134aaba-3600-4634-bddf-71bae87a4fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.468335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134aaba-3600-4634-bddf-71bae87a4fa2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-f134aaba-3600-4634-bddf-71bae87a4fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:00:56.483176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:56.484169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:00:56.485145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:00:56.485145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:00:56.485145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:56.485145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 401/806] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:56.490873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe3301-2071-473b-b356-55e567ae7320 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.583847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.598128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe3301-2071-473b-b356-55e567ae7320 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.633284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076a9f7-b4d8-44dd-8615-1e556ff505af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.633880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076a9f7-b4d8-44dd-8615-1e556ff505af None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.634155 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076a9f7-b4d8-44dd-8615-1e556ff505af None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.634419 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076a9f7-b4d8-44dd-8615-1e556ff505af None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.635067 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076a9f7-b4d8-44dd-8615-1e556ff505af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:56.635359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076a9f7-b4d8-44dd-8615-1e556ff505af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.636738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076a9f7-b4d8-44dd-8615-1e556ff505af None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.648493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 406/807] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:56.654428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134aaba-3600-4634-bddf-71bae87a4fa2 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.665555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:56.762925 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134aaba-3600-4634-bddf-71bae87a4fa2 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.797753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075ac86-1033-4b5c-9570-e46c164b122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.798364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ac86-1033-4b5c-9570-e46c164b122e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.798639 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ac86-1033-4b5c-9570-e46c164b122e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.798908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ac86-1033-4b5c-9570-e46c164b122e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.805792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075ac86-1033-4b5c-9570-e46c164b122e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.807246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075ac86-1033-4b5c-9570-e46c164b122e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c075ac86-1033-4b5c-9570-e46c164b122e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:00:56.818411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:56.819357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:56.820261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:00:56.820261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:00:56.820261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:00:56.820261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:00:56.820261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:00:56.820261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:00:56.820261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:00:56.820261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:56.820261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 402/808] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:56.825814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076a9f7-b4d8-44dd-8615-1e556ff505af None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:56.932082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076a9f7-b4d8-44dd-8615-1e556ff505af None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:56.966643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e4d25-0837-4265-a3d2-788accaa4104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:56.967244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4d25-0837-4265-a3d2-788accaa4104 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:56.967523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4d25-0837-4265-a3d2-788accaa4104 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:56.967788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4d25-0837-4265-a3d2-788accaa4104 None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:56.968499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e4d25-0837-4265-a3d2-788accaa4104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:56.968805 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e4d25-0837-4265-a3d2-788accaa4104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:56.970221 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e4d25-0837-4265-a3d2-788accaa4104 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:56.982552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 407/809] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:00:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:56.988712 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075ac86-1033-4b5c-9570-e46c164b122e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:57.056871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:57.092255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075ac86-1033-4b5c-9570-e46c164b122e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:57.126168 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2da5a-8645-4d18-b211-5501f311e28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:57.126817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2da5a-8645-4d18-b211-5501f311e28e None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.127093 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2da5a-8645-4d18-b211-5501f311e28e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.127388 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2da5a-8645-4d18-b211-5501f311e28e None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/d66e6f6ea62d439c87d9551286d29615/roles/f901b5b0f79d4ad290626ca5d21f9e10` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.129557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2da5a-8645-4d18-b211-5501f311e28e None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=d66e6f6ea62d439c87d9551286d29615, role_id=f901b5b0f79d4ad290626ca5d21f9e10)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:57.130983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2da5a-8645-4d18-b211-5501f311e28e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:57.144234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 403/810] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:56 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/d66e6f6ea62d439c87d9551286d29615/roles/f901b5b0f79d4ad290626ca5d21f9e10 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:57.917964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca30bee-5074-4d00-9d4e-dfa9e756b7d0 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.918534 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca30bee-5074-4d00-9d4e-dfa9e756b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.918534 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca30bee-5074-4d00-9d4e-dfa9e756b7d0 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.920140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 408/811] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:57.925420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75824-99ca-4ba2-bd79-f6e17488fba9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:57.925875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75824-99ca-4ba2-bd79-f6e17488fba9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:57.925977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75824-99ca-4ba2-bd79-f6e17488fba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:57.945156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-89c75824-99ca-4ba2-bd79-f6e17488fba9 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:57.946390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-89c75824-99ca-4ba2-bd79-f6e17488fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:58.018875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 404/812] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:00:58.284099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca30bee-5074-4d00-9d4e-dfa9e756b7d0 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.295609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.388841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca30bee-5074-4d00-9d4e-dfa9e756b7d0 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.423124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39678fae-e0d4-44c6-9cde-128f38baa6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.423743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39678fae-e0d4-44c6-9cde-128f38baa6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.424019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39678fae-e0d4-44c6-9cde-128f38baa6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.424344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39678fae-e0d4-44c6-9cde-128f38baa6f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.434294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39678fae-e0d4-44c6-9cde-128f38baa6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-39678fae-e0d4-44c6-9cde-128f38baa6f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:58.439081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:58.440158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:00:58.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 409/813] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:58.446367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c75824-99ca-4ba2-bd79-f6e17488fba9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.505104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.550803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c75824-99ca-4ba2-bd79-f6e17488fba9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.587379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c9d5-4b34-4b03-a0e8-4154583ba24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.587989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c9d5-4b34-4b03-a0e8-4154583ba24d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.588272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c9d5-4b34-4b03-a0e8-4154583ba24d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.588573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c9d5-4b34-4b03-a0e8-4154583ba24d None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.589243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c9d5-4b34-4b03-a0e8-4154583ba24d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:58.589545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c9d5-4b34-4b03-a0e8-4154583ba24d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.590918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c9d5-4b34-4b03-a0e8-4154583ba24d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.599190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 405/814] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:58.605216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39678fae-e0d4-44c6-9cde-128f38baa6f4 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.673294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.709272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39678fae-e0d4-44c6-9cde-128f38baa6f4 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.744108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e66b70-74a5-4bc9-a015-d4285c4b90a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.744768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e66b70-74a5-4bc9-a015-d4285c4b90a3 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.745047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e66b70-74a5-4bc9-a015-d4285c4b90a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.745318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e66b70-74a5-4bc9-a015-d4285c4b90a3 None admin] PATH_INFO: `/v3/users/f11ab26649f547e28a95327538059f20` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.759464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e66b70-74a5-4bc9-a015-d4285c4b90a3 None admin] RBAC: Authorizing `identity:get_user(user_id=f11ab26649f547e28a95327538059f20)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.760955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e66b70-74a5-4bc9-a015-d4285c4b90a3 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.762591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 410/815] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/users/f11ab26649f547e28a95327538059f20 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:58.768589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c9d5-4b34-4b03-a0e8-4154583ba24d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:58.873586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c9d5-4b34-4b03-a0e8-4154583ba24d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:58.890863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:58.909169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e01c84-eb1e-47fd-a6bb-a8ee15976dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:58.909798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e01c84-eb1e-47fd-a6bb-a8ee15976dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:58.910075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e01c84-eb1e-47fd-a6bb-a8ee15976dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:58.910344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e01c84-eb1e-47fd-a6bb-a8ee15976dd8 None admin] PATH_INFO: `/v3/projects/ca125897aa064037aa66160b76a97c8f` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:58.911470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e01c84-eb1e-47fd-a6bb-a8ee15976dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=ca125897aa064037aa66160b76a97c8f)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:58.912959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e01c84-eb1e-47fd-a6bb-a8ee15976dd8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:58.914589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 406/816] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 13:00:58 2022] GET /identity/v3/projects/ca125897aa064037aa66160b76a97c8f => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:58.920610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e66b70-74a5-4bc9-a015-d4285c4b90a3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.022253 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e66b70-74a5-4bc9-a015-d4285c4b90a3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:59.047197 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:59.057059 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a3b09-d6e1-4a77-9895-4ea3a983f3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:59.057722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a3b09-d6e1-4a77-9895-4ea3a983f3e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.057998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a3b09-d6e1-4a77-9895-4ea3a983f3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.058266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a3b09-d6e1-4a77-9895-4ea3a983f3e6 None admin] PATH_INFO: `/v3/projects/ca125897aa064037aa66160b76a97c8f/users/f11ab26649f547e28a95327538059f20/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.060267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a3b09-d6e1-4a77-9895-4ea3a983f3e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca125897aa064037aa66160b76a97c8f, user_id=f11ab26649f547e28a95327538059f20, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:59.061733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a3b09-d6e1-4a77-9895-4ea3a983f3e6 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:59.074510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 411/817] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:00:58 2022] PUT /identity/v3/projects/ca125897aa064037aa66160b76a97c8f/users/f11ab26649f547e28a95327538059f20/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:00:59.228736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daa9fd-9570-4cac-86db-5055b349c00a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.229343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daa9fd-9570-4cac-86db-5055b349c00a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.229343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daa9fd-9570-4cac-86db-5055b349c00a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.230627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 407/818] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:00:59.236918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e5d1-0437-473f-8c0c-fef721f3615b None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.237199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e5d1-0437-473f-8c0c-fef721f3615b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.237476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e5d1-0437-473f-8c0c-fef721f3615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.256940 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-1958e5d1-0437-473f-8c0c-fef721f3615b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:00:59.258176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1958e5d1-0437-473f-8c0c-fef721f3615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:00:59.327283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 412/819] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:00:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:00:59.587929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daa9fd-9570-4cac-86db-5055b349c00a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.694818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daa9fd-9570-4cac-86db-5055b349c00a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:59.737892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52899f7c-29c1-4a13-bfe5-9e58500a2542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:59.738522 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52899f7c-29c1-4a13-bfe5-9e58500a2542 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.738797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52899f7c-29c1-4a13-bfe5-9e58500a2542 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.739064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52899f7c-29c1-4a13-bfe5-9e58500a2542 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.750168 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52899f7c-29c1-4a13-bfe5-9e58500a2542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-52899f7c-29c1-4a13-bfe5-9e58500a2542 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:00:59.755004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:00:59.755954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:00:59.756825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 408/820] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:00:59.762498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958e5d1-0437-473f-8c0c-fef721f3615b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.862010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958e5d1-0437-473f-8c0c-fef721f3615b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:00:59.879208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:00:59.897620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2caab5-fef5-4baa-929d-a0e0204b7d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:00:59.898226 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2caab5-fef5-4baa-929d-a0e0204b7d16 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:00:59.898500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2caab5-fef5-4baa-929d-a0e0204b7d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:00:59.898764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2caab5-fef5-4baa-929d-a0e0204b7d16 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:00:59.899423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2caab5-fef5-4baa-929d-a0e0204b7d16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:00:59.899718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2caab5-fef5-4baa-929d-a0e0204b7d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:00:59.901114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2caab5-fef5-4baa-929d-a0e0204b7d16 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:00:59.909011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 413/821] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:00:59.915088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52899f7c-29c1-4a13-bfe5-9e58500a2542 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:00:59.963595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:00.018759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52899f7c-29c1-4a13-bfe5-9e58500a2542 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.053137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f71096-1d5f-4813-b275-a109dac61035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.053764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f71096-1d5f-4813-b275-a109dac61035 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.054050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f71096-1d5f-4813-b275-a109dac61035 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.054318 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f71096-1d5f-4813-b275-a109dac61035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.064967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f71096-1d5f-4813-b275-a109dac61035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.066419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f71096-1d5f-4813-b275-a109dac61035 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-26f71096-1d5f-4813-b275-a109dac61035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:00.080681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:00.081641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:00.082931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:00.082931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:00.082931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:01:00.082931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 409/822] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:00.087784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2caab5-fef5-4baa-929d-a0e0204b7d16 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.189891 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2caab5-fef5-4baa-929d-a0e0204b7d16 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.223631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb8f1-9e4d-4c95-85ad-70678b5eb165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.224240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb8f1-9e4d-4c95-85ad-70678b5eb165 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.224543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb8f1-9e4d-4c95-85ad-70678b5eb165 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.224812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb8f1-9e4d-4c95-85ad-70678b5eb165 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.225456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb8f1-9e4d-4c95-85ad-70678b5eb165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:00.225757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb8f1-9e4d-4c95-85ad-70678b5eb165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.227144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb8f1-9e4d-4c95-85ad-70678b5eb165 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:00.239009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 414/823] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:00.244923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f71096-1d5f-4813-b275-a109dac61035 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.346076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:00.350263 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f71096-1d5f-4813-b275-a109dac61035 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.385199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0fd2b-de78-4771-8f5a-da1fb39fea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.385820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0fd2b-de78-4771-8f5a-da1fb39fea71 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.386097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0fd2b-de78-4771-8f5a-da1fb39fea71 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.386366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0fd2b-de78-4771-8f5a-da1fb39fea71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.394478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0fd2b-de78-4771-8f5a-da1fb39fea71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.395923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0fd2b-de78-4771-8f5a-da1fb39fea71 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-49c0fd2b-de78-4771-8f5a-da1fb39fea71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:01:00.406772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:00.407790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:01:00.409316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 410/824] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:00.413865 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb8f1-9e4d-4c95-85ad-70678b5eb165 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.455679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:00.516540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb8f1-9e4d-4c95-85ad-70678b5eb165 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.551392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bbe03-c750-405e-89bb-2b0934b4086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.551990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bbe03-c750-405e-89bb-2b0934b4086a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.552263 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bbe03-c750-405e-89bb-2b0934b4086a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.552556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bbe03-c750-405e-89bb-2b0934b4086a None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.553269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bbe03-c750-405e-89bb-2b0934b4086a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:00.553569 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bbe03-c750-405e-89bb-2b0934b4086a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.555017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bbe03-c750-405e-89bb-2b0934b4086a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:00.571871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 415/825] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:00.577722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0fd2b-de78-4771-8f5a-da1fb39fea71 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.679832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0fd2b-de78-4771-8f5a-da1fb39fea71 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:00.715834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3cdd-cfaf-45f1-8e21-322cab037d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:00.716398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3cdd-cfaf-45f1-8e21-322cab037d78 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:00.716667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3cdd-cfaf-45f1-8e21-322cab037d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:00.716934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3cdd-cfaf-45f1-8e21-322cab037d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:00.745433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:00.787406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab3cdd-cfaf-45f1-8e21-322cab037d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:00.788901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab3cdd-cfaf-45f1-8e21-322cab037d78 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:00.892078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 411/826] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:01:00.897987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bbe03-c750-405e-89bb-2b0934b4086a None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:00.993531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:01.000283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bbe03-c750-405e-89bb-2b0934b4086a None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.034002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95578d3-c726-486e-819f-164f2be0ac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.034635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95578d3-c726-486e-819f-164f2be0ac4a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.034914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95578d3-c726-486e-819f-164f2be0ac4a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.035185 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95578d3-c726-486e-819f-164f2be0ac4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.046125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95578d3-c726-486e-819f-164f2be0ac4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.047614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95578d3-c726-486e-819f-164f2be0ac4a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-f95578d3-c726-486e-819f-164f2be0ac4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:01:01.064006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:01.065701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:01:01.066798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:01:01.066798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:01:01.066798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:01:01.066798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 416/827] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:01.071421 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3cdd-cfaf-45f1-8e21-322cab037d78 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.130158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:01.164723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872ad8-02f2-4d5a-bf24-d5277baa19a7 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.165264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872ad8-02f2-4d5a-bf24-d5277baa19a7 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.165264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872ad8-02f2-4d5a-bf24-d5277baa19a7 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.166600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 417/828] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:01.171778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f2040-fb26-405d-bb6e-efc19a4cd2c6 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.172092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f2040-fb26-405d-bb6e-efc19a4cd2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.172395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f2040-fb26-405d-bb6e-efc19a4cd2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.174706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3cdd-cfaf-45f1-8e21-322cab037d78 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.191055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d19f2040-fb26-405d-bb6e-efc19a4cd2c6 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:01.192256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d19f2040-fb26-405d-bb6e-efc19a4cd2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:01.210748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64419675-0c99-4415-9cde-48e0f10b1573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.211365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419675-0c99-4415-9cde-48e0f10b1573 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.211636 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419675-0c99-4415-9cde-48e0f10b1573 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.211920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419675-0c99-4415-9cde-48e0f10b1573 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.212588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64419675-0c99-4415-9cde-48e0f10b1573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:01.212887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64419675-0c99-4415-9cde-48e0f10b1573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.214248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64419675-0c99-4415-9cde-48e0f10b1573 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.226009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 412/829] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:01.231552 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64419675-0c99-4415-9cde-48e0f10b1573 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.258895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 418/830] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:01.332736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64419675-0c99-4415-9cde-48e0f10b1573 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.349514 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:01.366857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3ac3-dde1-41b1-8452-131aef4299c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.367481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3ac3-dde1-41b1-8452-131aef4299c7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.367752 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3ac3-dde1-41b1-8452-131aef4299c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.368015 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3ac3-dde1-41b1-8452-131aef4299c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.374886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d3ac3-dde1-41b1-8452-131aef4299c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.376350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d3ac3-dde1-41b1-8452-131aef4299c7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2e5d3ac3-dde1-41b1-8452-131aef4299c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:01:01.387348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:01.388257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:01.389220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:01:01.389220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:01:01.389220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:01:01.389220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:01:01.389220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:01:01.389220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:01:01.389220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:01:01.389220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:01:01.389220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 413/831] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:01.394530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f2040-fb26-405d-bb6e-efc19a4cd2c6 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.471884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:01.494359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f2040-fb26-405d-bb6e-efc19a4cd2c6 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.521853 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3ac3-dde1-41b1-8452-131aef4299c7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.528319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f9bfe-36e0-4cd0-83d4-bc3ec7bf53c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.528937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f9bfe-36e0-4cd0-83d4-bc3ec7bf53c5 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.529211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f9bfe-36e0-4cd0-83d4-bc3ec7bf53c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.529461 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f9bfe-36e0-4cd0-83d4-bc3ec7bf53c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.530149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f9bfe-36e0-4cd0-83d4-bc3ec7bf53c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:01.530446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f9bfe-36e0-4cd0-83d4-bc3ec7bf53c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.531874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f9bfe-36e0-4cd0-83d4-bc3ec7bf53c5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.543391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 419/832] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:01.549446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f9bfe-36e0-4cd0-83d4-bc3ec7bf53c5 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.626249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3ac3-dde1-41b1-8452-131aef4299c7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.647420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f9bfe-36e0-4cd0-83d4-bc3ec7bf53c5 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.658475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99095ee-4f12-476a-a0f9-6b52b00f9df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.659108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99095ee-4f12-476a-a0f9-6b52b00f9df6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.659383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99095ee-4f12-476a-a0f9-6b52b00f9df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.659655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99095ee-4f12-476a-a0f9-6b52b00f9df6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.669436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99095ee-4f12-476a-a0f9-6b52b00f9df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b99095ee-4f12-476a-a0f9-6b52b00f9df6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:01.674736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:01.675882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:01:01.676803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 414/833] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:01.680451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56dbdf-467c-4b8c-a45e-a81ce3f31b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.681028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56dbdf-467c-4b8c-a45e-a81ce3f31b87 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.681299 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56dbdf-467c-4b8c-a45e-a81ce3f31b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.681564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56dbdf-467c-4b8c-a45e-a81ce3f31b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.681821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99095ee-4f12-476a-a0f9-6b52b00f9df6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.682281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56dbdf-467c-4b8c-a45e-a81ce3f31b87 None admin] RBAC: Adding query filter params (role.id=f901b5b0f79d4ad290626ca5d21f9e10, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=d66e6f6ea62d439c87d9551286d29615) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:01.682581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56dbdf-467c-4b8c-a45e-a81ce3f31b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.684006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56dbdf-467c-4b8c-a45e-a81ce3f31b87 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.689852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 420/834] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/role_assignments?user.id=d66e6f6ea62d439c87d9551286d29615&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=f901b5b0f79d4ad290626ca5d21f9e10 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:01.725415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:01.795320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99095ee-4f12-476a-a0f9-6b52b00f9df6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.832887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdf090-a64c-4d27-b5df-1554de2620c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.833550 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdf090-a64c-4d27-b5df-1554de2620c1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.833824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdf090-a64c-4d27-b5df-1554de2620c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.834090 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdf090-a64c-4d27-b5df-1554de2620c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.834774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdf090-a64c-4d27-b5df-1554de2620c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:01.835074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdf090-a64c-4d27-b5df-1554de2620c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:01.836532 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdf090-a64c-4d27-b5df-1554de2620c1 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:01.847126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 415/835] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:01:01.854830 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56dbdf-467c-4b8c-a45e-a81ce3f31b87 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:01.857848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:01.963479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56dbdf-467c-4b8c-a45e-a81ce3f31b87 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:01.997189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baa79-6967-4707-bd4d-d6ed4d4409a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:01.998187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baa79-6967-4707-bd4d-d6ed4d4409a6 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:01.998465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baa79-6967-4707-bd4d-d6ed4d4409a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:01.998737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baa79-6967-4707-bd4d-d6ed4d4409a6 None admin] PATH_INFO: `/v3/users/f11ab26649f547e28a95327538059f20` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:01.999852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789baa79-6967-4707-bd4d-d6ed4d4409a6 None admin] RBAC: Authorizing `identity:get_user(user_id=f11ab26649f547e28a95327538059f20)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.001336 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789baa79-6967-4707-bd4d-d6ed4d4409a6 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.002985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 421/836] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:01 2022] GET /identity/v3/users/f11ab26649f547e28a95327538059f20 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:02.009073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdf090-a64c-4d27-b5df-1554de2620c1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.105356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.108146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdf090-a64c-4d27-b5df-1554de2620c1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:02.143278 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d6bee-a4c8-4957-948f-0813860ec7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:02.143891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d6bee-a4c8-4957-948f-0813860ec7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.144165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d6bee-a4c8-4957-948f-0813860ec7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.144458 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d6bee-a4c8-4957-948f-0813860ec7c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.210447 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d6bee-a4c8-4957-948f-0813860ec7c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.211899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d6bee-a4c8-4957-948f-0813860ec7c3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.305334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.310292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 416/837] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:01:02.315083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baa79-6967-4707-bd4d-d6ed4d4409a6 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.387056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:02.417854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baa79-6967-4707-bd4d-d6ed4d4409a6 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:02.451897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f4b44-5274-4ed8-a8ce-f36a8a228242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:02.452598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f4b44-5274-4ed8-a8ce-f36a8a228242 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.452880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f4b44-5274-4ed8-a8ce-f36a8a228242 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.453153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f4b44-5274-4ed8-a8ce-f36a8a228242 None admin] PATH_INFO: `/v3/projects/ca125897aa064037aa66160b76a97c8f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.454297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f4b44-5274-4ed8-a8ce-f36a8a228242 None admin] RBAC: Authorizing `identity:get_project(project_id=ca125897aa064037aa66160b76a97c8f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.455736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f4b44-5274-4ed8-a8ce-f36a8a228242 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.457426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 422/838] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 13:01:02 2022] GET /identity/v3/projects/ca125897aa064037aa66160b76a97c8f => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:02.464018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d6bee-a4c8-4957-948f-0813860ec7c3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:02.562621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d6bee-a4c8-4957-948f-0813860ec7c3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:02.597362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2bddf-79b0-48ac-b02c-b1f50dac1a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:02.597973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2bddf-79b0-48ac-b02c-b1f50dac1a28 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:02.598253 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2bddf-79b0-48ac-b02c-b1f50dac1a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:02.598529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2bddf-79b0-48ac-b02c-b1f50dac1a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:02.599258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2bddf-79b0-48ac-b02c-b1f50dac1a28 None admin] RBAC: Adding query filter params (role.id=67447f88528849c59df641acc7768c92, scope.project.id=ca125897aa064037aa66160b76a97c8f, user.id=f11ab26649f547e28a95327538059f20) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:02.599567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2bddf-79b0-48ac-b02c-b1f50dac1a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:02.601022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2bddf-79b0-48ac-b02c-b1f50dac1a28 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:02.606909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 417/839] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:02 2022] GET /identity/v3/role_assignments?user.id=f11ab26649f547e28a95327538059f20&scope.project.id=ca125897aa064037aa66160b76a97c8f&role.id=67447f88528849c59df641acc7768c92 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:04.744353 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d060f-a1f4-4404-8a13-0fdbcd88fcac None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:04.744957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d060f-a1f4-4404-8a13-0fdbcd88fcac None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:04.744957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d060f-a1f4-4404-8a13-0fdbcd88fcac None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:04.746934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 423/840] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:04.755169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3778-0af2-4b20-8156-6ad41ed8a9ef None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:04.755615 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3778-0af2-4b20-8156-6ad41ed8a9ef None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:04.755730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3778-0af2-4b20-8156-6ad41ed8a9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:04.776203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-978e3778-0af2-4b20-8156-6ad41ed8a9ef None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:04.777426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-978e3778-0af2-4b20-8156-6ad41ed8a9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:04.841408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:04.851246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 418/841] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:01:05.116537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d060f-a1f4-4404-8a13-0fdbcd88fcac None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:05.232572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d060f-a1f4-4404-8a13-0fdbcd88fcac None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:05.267447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845c44b-fc99-4434-adb8-dcf184b9aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:05.268149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845c44b-fc99-4434-adb8-dcf184b9aa51 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:05.268464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845c44b-fc99-4434-adb8-dcf184b9aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:05.268733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845c44b-fc99-4434-adb8-dcf184b9aa51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:05.269897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845c44b-fc99-4434-adb8-dcf184b9aa51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:05.271351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845c44b-fc99-4434-adb8-dcf184b9aa51 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:05.272937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 424/842] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:05.282077 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e3778-0af2-4b20-8156-6ad41ed8a9ef None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:05.395787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e3778-0af2-4b20-8156-6ad41ed8a9ef None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:05.432703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5c099-797a-4d1e-a3ca-2f37ee87de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:05.433303 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5c099-797a-4d1e-a3ca-2f37ee87de9f None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:05.433573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5c099-797a-4d1e-a3ca-2f37ee87de9f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:05.433838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5c099-797a-4d1e-a3ca-2f37ee87de9f None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:05.434480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5c099-797a-4d1e-a3ca-2f37ee87de9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:05.435899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5c099-797a-4d1e-a3ca-2f37ee87de9f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:05.460153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 419/843] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 13:01:05 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:07.632789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42fa8b-fcb7-48ef-8a03-b36b3ba2a6b1 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.633395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42fa8b-fcb7-48ef-8a03-b36b3ba2a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.633395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42fa8b-fcb7-48ef-8a03-b36b3ba2a6b1 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.634727 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 425/844] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:07.641187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638f00-1924-448a-846a-d5311515b268 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:07.641912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638f00-1924-448a-846a-d5311515b268 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:07.642072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638f00-1924-448a-846a-d5311515b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:07.661928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-89638f00-1924-448a-846a-d5311515b268 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:07.663110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-89638f00-1924-448a-846a-d5311515b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:07.723987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:07.746273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 420/845] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:08.009667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42fa8b-fcb7-48ef-8a03-b36b3ba2a6b1 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.020273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:08.120580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42fa8b-fcb7-48ef-8a03-b36b3ba2a6b1 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.154884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932da121-8551-4043-b1f1-f33af1dd8958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.155495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da121-8551-4043-b1f1-f33af1dd8958 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.155771 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da121-8551-4043-b1f1-f33af1dd8958 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.156038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da121-8551-4043-b1f1-f33af1dd8958 None admin] PATH_INFO: `/v3/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.157633 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932da121-8551-4043-b1f1-f33af1dd8958 None admin] RBAC: Authorizing `identity:get_role(role_id=e1bfcdd2169d4f49bb8a72e8dd7c33cf)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.159032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932da121-8551-4043-b1f1-f33af1dd8958 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.160346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 426/846] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:08.166837 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89638f00-1924-448a-846a-d5311515b268 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.274706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89638f00-1924-448a-846a-d5311515b268 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.309822 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd26c-6979-418b-a745-9b6e0e288020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.310439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd26c-6979-418b-a745-9b6e0e288020 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.310713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd26c-6979-418b-a745-9b6e0e288020 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.310985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd26c-6979-418b-a745-9b6e0e288020 None admin] PATH_INFO: `/v3/users/ddfbc5627091455aa753588f90390a78` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.324543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bd26c-6979-418b-a745-9b6e0e288020 None admin] RBAC: Authorizing `identity:get_user(user_id=ddfbc5627091455aa753588f90390a78)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.325978 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bd26c-6979-418b-a745-9b6e0e288020 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.327553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 421/847] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/users/ddfbc5627091455aa753588f90390a78 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:08.336712 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932da121-8551-4043-b1f1-f33af1dd8958 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.415879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:08.448197 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932da121-8551-4043-b1f1-f33af1dd8958 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.492830 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0a182-dc21-41b0-a549-f70ab749b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.493456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0a182-dc21-41b0-a549-f70ab749b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.493739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0a182-dc21-41b0-a549-f70ab749b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.494013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0a182-dc21-41b0-a549-f70ab749b4c9 None admin] PATH_INFO: `/v3/projects/ca125897aa064037aa66160b76a97c8f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.495126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0a182-dc21-41b0-a549-f70ab749b4c9 None admin] RBAC: Authorizing `identity:get_project(project_id=ca125897aa064037aa66160b76a97c8f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.496609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0a182-dc21-41b0-a549-f70ab749b4c9 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.498615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 427/848] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 13:01:08 2022] GET /identity/v3/projects/ca125897aa064037aa66160b76a97c8f => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:08.506137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd26c-6979-418b-a745-9b6e0e288020 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:08.549652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:08.611428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd26c-6979-418b-a745-9b6e0e288020 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:08.649183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22e9b6-0325-44a4-8d0c-e1696aed5998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:08.649791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e9b6-0325-44a4-8d0c-e1696aed5998 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:08.650100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e9b6-0325-44a4-8d0c-e1696aed5998 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:08.650373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e9b6-0325-44a4-8d0c-e1696aed5998 None admin] PATH_INFO: `/v3/projects/ca125897aa064037aa66160b76a97c8f/users/ddfbc5627091455aa753588f90390a78/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:08.652939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22e9b6-0325-44a4-8d0c-e1696aed5998 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca125897aa064037aa66160b76a97c8f, user_id=ddfbc5627091455aa753588f90390a78, role_id=e1bfcdd2169d4f49bb8a72e8dd7c33cf)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:08.654385 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22e9b6-0325-44a4-8d0c-e1696aed5998 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:08.673098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 422/849] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:01:08 2022] PUT /identity/v3/projects/ca125897aa064037aa66160b76a97c8f/users/ddfbc5627091455aa753588f90390a78/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:01:10.787782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1e067-0222-4df7-94ce-0d82397ff6e9 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.788707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1e067-0222-4df7-94ce-0d82397ff6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.788871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1e067-0222-4df7-94ce-0d82397ff6e9 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.790946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 428/850] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:10.797372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70ee6-f943-4030-bab0-002427aac747 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:10.797817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70ee6-f943-4030-bab0-002427aac747 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:10.797933 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70ee6-f943-4030-bab0-002427aac747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:10.822932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-6fe70ee6-f943-4030-bab0-002427aac747 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:10.824116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6fe70ee6-f943-4030-bab0-002427aac747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:10.892889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 423/851] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:11.156029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1e067-0222-4df7-94ce-0d82397ff6e9 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:11.265833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1e067-0222-4df7-94ce-0d82397ff6e9 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:11.303949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd8ac9-4e50-4387-bd1e-51177794e150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:11.304586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd8ac9-4e50-4387-bd1e-51177794e150 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.304858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd8ac9-4e50-4387-bd1e-51177794e150 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.305125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd8ac9-4e50-4387-bd1e-51177794e150 None admin] PATH_INFO: `/v3/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.306618 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd8ac9-4e50-4387-bd1e-51177794e150 None admin] RBAC: Authorizing `identity:get_role(role_id=e1bfcdd2169d4f49bb8a72e8dd7c33cf)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:11.307981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd8ac9-4e50-4387-bd1e-51177794e150 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:11.309316 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 429/852] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:11 2022] GET /identity/v3/roles/e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:11.318530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe70ee6-f943-4030-bab0-002427aac747 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:11.352154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:11.426538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe70ee6-f943-4030-bab0-002427aac747 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:11.461250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f9b4c-01b1-463b-bbc8-8b2ebbb3e356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:11.461870 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f9b4c-01b1-463b-bbc8-8b2ebbb3e356 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.462140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f9b4c-01b1-463b-bbc8-8b2ebbb3e356 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.462406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f9b4c-01b1-463b-bbc8-8b2ebbb3e356 None admin] PATH_INFO: `/v3/users/ddfbc5627091455aa753588f90390a78` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.463620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f9b4c-01b1-463b-bbc8-8b2ebbb3e356 None admin] RBAC: Authorizing `identity:get_user(user_id=ddfbc5627091455aa753588f90390a78)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:11.465100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f9b4c-01b1-463b-bbc8-8b2ebbb3e356 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:11.466640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 424/853] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:11 2022] GET /identity/v3/users/ddfbc5627091455aa753588f90390a78 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:11.473265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd8ac9-4e50-4387-bd1e-51177794e150 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:11.494020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:11.585923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd8ac9-4e50-4387-bd1e-51177794e150 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:11.620128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f77e89-ce22-4b1c-b7ce-5fce00deb587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:11.620754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f77e89-ce22-4b1c-b7ce-5fce00deb587 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.621030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f77e89-ce22-4b1c-b7ce-5fce00deb587 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.621297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f77e89-ce22-4b1c-b7ce-5fce00deb587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.691881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f77e89-ce22-4b1c-b7ce-5fce00deb587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:11.693321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f77e89-ce22-4b1c-b7ce-5fce00deb587 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:11.703939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:11.796334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 430/854] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:01:11.802623 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f9b4c-01b1-463b-bbc8-8b2ebbb3e356 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:11.903907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:11.911447 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f9b4c-01b1-463b-bbc8-8b2ebbb3e356 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:11.948581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4086ae3-e0d8-4d7b-93bc-d13741d50423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:11.949144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4086ae3-e0d8-4d7b-93bc-d13741d50423 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:11.949427 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4086ae3-e0d8-4d7b-93bc-d13741d50423 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:11.949701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4086ae3-e0d8-4d7b-93bc-d13741d50423 None admin] PATH_INFO: `/v3/projects/ca125897aa064037aa66160b76a97c8f` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:11.950918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4086ae3-e0d8-4d7b-93bc-d13741d50423 None admin] RBAC: Authorizing `identity:get_project(project_id=ca125897aa064037aa66160b76a97c8f)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:11.952398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4086ae3-e0d8-4d7b-93bc-d13741d50423 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:11.954067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 425/855] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 13:01:11 2022] GET /identity/v3/projects/ca125897aa064037aa66160b76a97c8f => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:11.960855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f77e89-ce22-4b1c-b7ce-5fce00deb587 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:12.062931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f77e89-ce22-4b1c-b7ce-5fce00deb587 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:12.074950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:12.099828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3fbc9-ef3b-4c63-89cd-191818864a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:12.100454 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3fbc9-ef3b-4c63-89cd-191818864a64 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:12.100733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3fbc9-ef3b-4c63-89cd-191818864a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:12.100999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3fbc9-ef3b-4c63-89cd-191818864a64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:12.101748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3fbc9-ef3b-4c63-89cd-191818864a64 None admin] RBAC: Adding query filter params (role.id=e1bfcdd2169d4f49bb8a72e8dd7c33cf, scope.project.id=ca125897aa064037aa66160b76a97c8f, user.id=ddfbc5627091455aa753588f90390a78) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:12.102050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3fbc9-ef3b-4c63-89cd-191818864a64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:12.103455 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3fbc9-ef3b-4c63-89cd-191818864a64 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:12.109009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 431/856] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:11 2022] GET /identity/v3/role_assignments?user.id=ddfbc5627091455aa753588f90390a78&scope.project.id=ca125897aa064037aa66160b76a97c8f&role.id=e1bfcdd2169d4f49bb8a72e8dd7c33cf => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:14.232885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ca124-8a17-46ff-89ff-84d7d05e97ba None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.233463 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ca124-8a17-46ff-89ff-84d7d05e97ba None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.233463 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ca124-8a17-46ff-89ff-84d7d05e97ba None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.235491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 426/857] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:14.242175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1ee0-431a-436e-90f9-b0a1b4c72fc7 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.242570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1ee0-431a-436e-90f9-b0a1b4c72fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.242745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1ee0-431a-436e-90f9-b0a1b4c72fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.263558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-3fcb1ee0-431a-436e-90f9-b0a1b4c72fc7 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:14.264775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3fcb1ee0-431a-436e-90f9-b0a1b4c72fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:14.333880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 432/858] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:14.598294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ca124-8a17-46ff-89ff-84d7d05e97ba None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.704395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ca124-8a17-46ff-89ff-84d7d05e97ba None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:14.739278 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e91d1-802b-42d0-b966-15513320c8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:14.739891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e91d1-802b-42d0-b966-15513320c8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.740165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e91d1-802b-42d0-b966-15513320c8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.740457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e91d1-802b-42d0-b966-15513320c8c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.741664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e91d1-802b-42d0-b966-15513320c8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:14.743095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e91d1-802b-42d0-b966-15513320c8c8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:14.744669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 427/859] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:14.751011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1ee0-431a-436e-90f9-b0a1b4c72fc7 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:14.849983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1ee0-431a-436e-90f9-b0a1b4c72fc7 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:14.852484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:14.886736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d777c-aea9-4ae3-9061-decbb579eecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:14.887344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d777c-aea9-4ae3-9061-decbb579eecc None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:14.887617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d777c-aea9-4ae3-9061-decbb579eecc None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:14.887884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d777c-aea9-4ae3-9061-decbb579eecc None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:14.888567 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d777c-aea9-4ae3-9061-decbb579eecc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:14.889996 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d777c-aea9-4ae3-9061-decbb579eecc None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:14.919343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 433/860] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:01:14 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:17.084956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27dad7-0faa-4af4-b4ed-6cd196158958 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:17.085897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27dad7-0faa-4af4-b4ed-6cd196158958 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:17.085897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27dad7-0faa-4af4-b4ed-6cd196158958 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:17.087904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 428/861] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:17.096997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5b4eb-2b62-40b8-bda4-378ea23374ed None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:17.097383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5b4eb-2b62-40b8-bda4-378ea23374ed None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:17.097490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5b4eb-2b62-40b8-bda4-378ea23374ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:17.120925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-f1a5b4eb-2b62-40b8-bda4-378ea23374ed None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:17.122118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f1a5b4eb-2b62-40b8-bda4-378ea23374ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:17.194127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 434/862] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:17.465359 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27dad7-0faa-4af4-b4ed-6cd196158958 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:17.507171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:17.585419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27dad7-0faa-4af4-b4ed-6cd196158958 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:17.621980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e89cb-b993-4c33-9410-0bc6929e03a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:17.622967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e89cb-b993-4c33-9410-0bc6929e03a6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:17.623244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e89cb-b993-4c33-9410-0bc6929e03a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:17.623515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e89cb-b993-4c33-9410-0bc6929e03a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:17.624706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e89cb-b993-4c33-9410-0bc6929e03a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:17.626150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e89cb-b993-4c33-9410-0bc6929e03a6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:17.627778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 429/863] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:01:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:17.633931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5b4eb-2b62-40b8-bda4-378ea23374ed None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:17.718637 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:17.734792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5b4eb-2b62-40b8-bda4-378ea23374ed None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:17.769430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03253b67-4fbd-45e4-84f6-7ca7278ac0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:17.770024 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03253b67-4fbd-45e4-84f6-7ca7278ac0f7 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:17.770301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03253b67-4fbd-45e4-84f6-7ca7278ac0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:17.770568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03253b67-4fbd-45e4-84f6-7ca7278ac0f7 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:17.771212 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03253b67-4fbd-45e4-84f6-7ca7278ac0f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:17.772674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03253b67-4fbd-45e4-84f6-7ca7278ac0f7 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:17.799897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 435/864] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 13:01:17 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:19.944325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084b6ea-7ae1-42fa-b228-f9f747c2ed6a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.944874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084b6ea-7ae1-42fa-b228-f9f747c2ed6a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.944874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084b6ea-7ae1-42fa-b228-f9f747c2ed6a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.946219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 430/865] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:19.952606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2147b-bfb2-41a8-8437-e8ae93eb4dc5 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:19.953344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2147b-bfb2-41a8-8437-e8ae93eb4dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:19.953490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2147b-bfb2-41a8-8437-e8ae93eb4dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:19.979808 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-17a2147b-bfb2-41a8-8437-e8ae93eb4dc5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:19.981063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-17a2147b-bfb2-41a8-8437-e8ae93eb4dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:20.053608 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 436/866] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:20.326836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084b6ea-7ae1-42fa-b228-f9f747c2ed6a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.435309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:20.440585 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084b6ea-7ae1-42fa-b228-f9f747c2ed6a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.476638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f729e0f-f03c-4e6a-9e7b-213822ca8fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.477260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f729e0f-f03c-4e6a-9e7b-213822ca8fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.477538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f729e0f-f03c-4e6a-9e7b-213822ca8fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.477808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f729e0f-f03c-4e6a-9e7b-213822ca8fb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.488117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f729e0f-f03c-4e6a-9e7b-213822ca8fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-0f729e0f-f03c-4e6a-9e7b-213822ca8fb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:20.493824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:20.494945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:01:20.496096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 431/867] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:20.503532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2147b-bfb2-41a8-8437-e8ae93eb4dc5 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.574589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:20.611475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2147b-bfb2-41a8-8437-e8ae93eb4dc5 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.646739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c087f49-79cf-47f3-80c1-2783a2dcfa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.647344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c087f49-79cf-47f3-80c1-2783a2dcfa56 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.647642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c087f49-79cf-47f3-80c1-2783a2dcfa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.647910 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c087f49-79cf-47f3-80c1-2783a2dcfa56 None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.648597 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c087f49-79cf-47f3-80c1-2783a2dcfa56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:20.648893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c087f49-79cf-47f3-80c1-2783a2dcfa56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.650266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c087f49-79cf-47f3-80c1-2783a2dcfa56 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.658070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 437/868] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:20.664223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f729e0f-f03c-4e6a-9e7b-213822ca8fb1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.770379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f729e0f-f03c-4e6a-9e7b-213822ca8fb1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.806088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17fc02-998d-47fc-8173-6eb571b57f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.806703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17fc02-998d-47fc-8173-6eb571b57f8d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.806975 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17fc02-998d-47fc-8173-6eb571b57f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.807239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17fc02-998d-47fc-8173-6eb571b57f8d None admin] PATH_INFO: `/v3/users/cbce0adf0aea42c6870238c925dec8a5` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.820495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17fc02-998d-47fc-8173-6eb571b57f8d None admin] RBAC: Authorizing `identity:get_user(user_id=cbce0adf0aea42c6870238c925dec8a5)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.821936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17fc02-998d-47fc-8173-6eb571b57f8d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.823508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 432/869] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/users/cbce0adf0aea42c6870238c925dec8a5 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:20.830073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c087f49-79cf-47f3-80c1-2783a2dcfa56 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:20.944547 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c087f49-79cf-47f3-80c1-2783a2dcfa56 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:20.978701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c438e09-56af-4581-bdd9-8fad479e51dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:20.979281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438e09-56af-4581-bdd9-8fad479e51dc None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:20.979575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438e09-56af-4581-bdd9-8fad479e51dc None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:20.979844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438e09-56af-4581-bdd9-8fad479e51dc None admin] PATH_INFO: `/v3/projects/c8a3319d49a94f159ce33df60d9f062c` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:20.981114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c438e09-56af-4581-bdd9-8fad479e51dc None admin] RBAC: Authorizing `identity:get_project(project_id=c8a3319d49a94f159ce33df60d9f062c)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:20.982540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c438e09-56af-4581-bdd9-8fad479e51dc None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:20.984160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 438/870] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 13:01:20 2022] GET /identity/v3/projects/c8a3319d49a94f159ce33df60d9f062c => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:20.990477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17fc02-998d-47fc-8173-6eb571b57f8d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:21.010130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:21.092773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17fc02-998d-47fc-8173-6eb571b57f8d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:21.128364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6b055-e4a7-4a1d-a873-64d8c36925ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:21.129025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6b055-e4a7-4a1d-a873-64d8c36925ef None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:21.129299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6b055-e4a7-4a1d-a873-64d8c36925ef None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:21.129564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6b055-e4a7-4a1d-a873-64d8c36925ef None admin] PATH_INFO: `/v3/projects/c8a3319d49a94f159ce33df60d9f062c/users/cbce0adf0aea42c6870238c925dec8a5/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:21.131579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6b055-e4a7-4a1d-a873-64d8c36925ef None admin] RBAC: Authorizing `identity:create_grant(project_id=c8a3319d49a94f159ce33df60d9f062c, user_id=cbce0adf0aea42c6870238c925dec8a5, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:21.133034 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6b055-e4a7-4a1d-a873-64d8c36925ef None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:21.149376 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 433/871] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:01:20 2022] PUT /identity/v3/projects/c8a3319d49a94f159ce33df60d9f062c/users/cbce0adf0aea42c6870238c925dec8a5/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:01:23.239445 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fad0b-118b-40a5-80aa-c0f4019d487d None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.240343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fad0b-118b-40a5-80aa-c0f4019d487d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.240462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fad0b-118b-40a5-80aa-c0f4019d487d None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.242613 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 439/872] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:23.249360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f8feb-af5e-446c-bf86-7b4c2c14b976 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.250048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f8feb-af5e-446c-bf86-7b4c2c14b976 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.250179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f8feb-af5e-446c-bf86-7b4c2c14b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.275511 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-cc9f8feb-af5e-446c-bf86-7b4c2c14b976 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:23.276737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cc9f8feb-af5e-446c-bf86-7b4c2c14b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:23.347405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 434/873] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:23.614843 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fad0b-118b-40a5-80aa-c0f4019d487d None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:23.618174 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:23.723970 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fad0b-118b-40a5-80aa-c0f4019d487d None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:23.760248 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09252f9b-43f8-420c-b114-75ded686fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:23.760892 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09252f9b-43f8-420c-b114-75ded686fae3 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.761169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09252f9b-43f8-420c-b114-75ded686fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.761440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09252f9b-43f8-420c-b114-75ded686fae3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.772968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09252f9b-43f8-420c-b114-75ded686fae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-09252f9b-43f8-420c-b114-75ded686fae3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:23.777668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:23.778723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:01:23.779769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 440/874] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:01:23.785670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f8feb-af5e-446c-bf86-7b4c2c14b976 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:23.800238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:23.896540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f8feb-af5e-446c-bf86-7b4c2c14b976 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:23.932081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71026b4-7440-4fe8-b62a-891675eda557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:23.932717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71026b4-7440-4fe8-b62a-891675eda557 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:23.932991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71026b4-7440-4fe8-b62a-891675eda557 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:23.933259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71026b4-7440-4fe8-b62a-891675eda557 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:23.933922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71026b4-7440-4fe8-b62a-891675eda557 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:23.934218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71026b4-7440-4fe8-b62a-891675eda557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:23.935588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71026b4-7440-4fe8-b62a-891675eda557 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:23.943613 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 435/875] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:23.949982 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09252f9b-43f8-420c-b114-75ded686fae3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:24.015964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:24.057118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09252f9b-43f8-420c-b114-75ded686fae3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:24.091103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fe3e-ed5c-4ab6-9dae-a06430901118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:24.091714 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fe3e-ed5c-4ab6-9dae-a06430901118 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:24.091993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fe3e-ed5c-4ab6-9dae-a06430901118 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:24.092261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fe3e-ed5c-4ab6-9dae-a06430901118 None admin] PATH_INFO: `/v3/users/cbce0adf0aea42c6870238c925dec8a5` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:24.093490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2fe3e-ed5c-4ab6-9dae-a06430901118 None admin] RBAC: Authorizing `identity:get_user(user_id=cbce0adf0aea42c6870238c925dec8a5)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:24.094926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2fe3e-ed5c-4ab6-9dae-a06430901118 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:24.096557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 441/876] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:23 2022] GET /identity/v3/users/cbce0adf0aea42c6870238c925dec8a5 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:24.102714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71026b4-7440-4fe8-b62a-891675eda557 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:24.175590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:24.208565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71026b4-7440-4fe8-b62a-891675eda557 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:24.242776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e87c88-b830-44d0-b0d1-472a100e0229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:24.243364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e87c88-b830-44d0-b0d1-472a100e0229 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:24.243638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e87c88-b830-44d0-b0d1-472a100e0229 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:24.243908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e87c88-b830-44d0-b0d1-472a100e0229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:24.311907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e87c88-b830-44d0-b0d1-472a100e0229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:24.313367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e87c88-b830-44d0-b0d1-472a100e0229 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:24.381449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:24.543150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 436/877] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:01:24.549447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fe3e-ed5c-4ab6-9dae-a06430901118 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:24.656277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fe3e-ed5c-4ab6-9dae-a06430901118 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:24.684003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:24.693209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d789fbb-5f31-4e0f-ae1f-3bd8371dc482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:24.694230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d789fbb-5f31-4e0f-ae1f-3bd8371dc482 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:24.694655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d789fbb-5f31-4e0f-ae1f-3bd8371dc482 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:24.695027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d789fbb-5f31-4e0f-ae1f-3bd8371dc482 None admin] PATH_INFO: `/v3/projects/c8a3319d49a94f159ce33df60d9f062c` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:24.696884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d789fbb-5f31-4e0f-ae1f-3bd8371dc482 None admin] RBAC: Authorizing `identity:get_project(project_id=c8a3319d49a94f159ce33df60d9f062c)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:24.699180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d789fbb-5f31-4e0f-ae1f-3bd8371dc482 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:24.701734 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 442/878] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 13:01:24 2022] GET /identity/v3/projects/c8a3319d49a94f159ce33df60d9f062c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:24.709090 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e87c88-b830-44d0-b0d1-472a100e0229 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:24.814127 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e87c88-b830-44d0-b0d1-472a100e0229 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:24.849983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd82ae1-92e8-4862-bbdd-e2c6c741c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:24.850589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd82ae1-92e8-4862-bbdd-e2c6c741c3fc None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:24.850865 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd82ae1-92e8-4862-bbdd-e2c6c741c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:24.851138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd82ae1-92e8-4862-bbdd-e2c6c741c3fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:24.851862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd82ae1-92e8-4862-bbdd-e2c6c741c3fc None admin] RBAC: Adding query filter params (role.id=67447f88528849c59df641acc7768c92, scope.project.id=c8a3319d49a94f159ce33df60d9f062c, user.id=cbce0adf0aea42c6870238c925dec8a5) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:24.852165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd82ae1-92e8-4862-bbdd-e2c6c741c3fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:24.853613 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd82ae1-92e8-4862-bbdd-e2c6c741c3fc None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:24.860019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 437/879] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:24 2022] GET /identity/v3/role_assignments?user.id=cbce0adf0aea42c6870238c925dec8a5&scope.project.id=c8a3319d49a94f159ce33df60d9f062c&role.id=67447f88528849c59df641acc7768c92 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:26.971786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47652593-6cb6-4746-a7d6-2c6f8448be53 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.972682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47652593-6cb6-4746-a7d6-2c6f8448be53 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.972682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47652593-6cb6-4746-a7d6-2c6f8448be53 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:26.974966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 443/880] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:26.981302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074866-16bb-438a-aaa3-476c333280ca None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:26.982030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074866-16bb-438a-aaa3-476c333280ca None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:26.982174 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074866-16bb-438a-aaa3-476c333280ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.004947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-6e074866-16bb-438a-aaa3-476c333280ca None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:27.006181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6e074866-16bb-438a-aaa3-476c333280ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:27.035598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:27.078504 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 438/881] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:27.342840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47652593-6cb6-4746-a7d6-2c6f8448be53 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:27.452118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47652593-6cb6-4746-a7d6-2c6f8448be53 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:27.486371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd83ab-ef6f-45a0-9d9d-ab640cffb2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:27.486962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd83ab-ef6f-45a0-9d9d-ab640cffb2d0 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:27.487234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd83ab-ef6f-45a0-9d9d-ab640cffb2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:27.487500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd83ab-ef6f-45a0-9d9d-ab640cffb2d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:27.488161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd83ab-ef6f-45a0-9d9d-ab640cffb2d0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:27.489536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd83ab-ef6f-45a0-9d9d-ab640cffb2d0 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:27.510273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 444/882] 10.222.0.15 () {60 vars in 1138 bytes} [Mon Oct 24 13:01:27 2022] POST /identity/v3/domains => generated 267 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:29.653516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5369-0607-4f0b-a5fd-c1109080efba None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:29.654454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5369-0607-4f0b-a5fd-c1109080efba None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:29.654454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5369-0607-4f0b-a5fd-c1109080efba None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:29.656620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 439/883] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:29.662125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e0eff-294f-4c7c-ac8c-07fd81d6ecd2 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:29.662571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e0eff-294f-4c7c-ac8c-07fd81d6ecd2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:29.662667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e0eff-294f-4c7c-ac8c-07fd81d6ecd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:29.682361 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-6d3e0eff-294f-4c7c-ac8c-07fd81d6ecd2 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:29.683532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6d3e0eff-294f-4c7c-ac8c-07fd81d6ecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:29.737159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:29.757262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 445/884] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:30.021576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5369-0607-4f0b-a5fd-c1109080efba None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:30.134403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5369-0607-4f0b-a5fd-c1109080efba None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:30.179592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905f49-5a77-436d-a6a3-1578e3164810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:30.180349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905f49-5a77-436d-a6a3-1578e3164810 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.180481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905f49-5a77-436d-a6a3-1578e3164810 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.180780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905f49-5a77-436d-a6a3-1578e3164810 None admin] PATH_INFO: `/v3/domains/1b86a838f6ae4dc7931e9ff47d3e65db` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.191928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09905f49-5a77-436d-a6a3-1578e3164810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1b86a838f6ae4dc7931e9ff47d3e65db)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:30.193402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09905f49-5a77-436d-a6a3-1578e3164810 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:30.194955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 440/885] 10.222.0.15 () {56 vars in 1183 bytes} [Mon Oct 24 13:01:30 2022] GET /identity/v3/domains/1b86a838f6ae4dc7931e9ff47d3e65db => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:30.201456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e0eff-294f-4c7c-ac8c-07fd81d6ecd2 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:30.313601 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e0eff-294f-4c7c-ac8c-07fd81d6ecd2 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:30.348493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6e7ab-2893-4642-8691-0a5ce2e0132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:30.349091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6e7ab-2893-4642-8691-0a5ce2e0132e None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:30.349366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6e7ab-2893-4642-8691-0a5ce2e0132e None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:30.349636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6e7ab-2893-4642-8691-0a5ce2e0132e None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:30.350287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6e7ab-2893-4642-8691-0a5ce2e0132e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:30.351711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6e7ab-2893-4642-8691-0a5ce2e0132e None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:30.389823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 446/886] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:01:30 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:32.543886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f80c6-c24e-4991-a411-45446fad61de None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:32.544509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f80c6-c24e-4991-a411-45446fad61de None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:32.544509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f80c6-c24e-4991-a411-45446fad61de None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:32.545823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 441/887] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:32.552449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a616-746b-407d-b982-7a35c6e788d5 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:32.553236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a616-746b-407d-b982-7a35c6e788d5 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:32.553477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a616-746b-407d-b982-7a35c6e788d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:32.577295 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-51b1a616-746b-407d-b982-7a35c6e788d5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:32.578521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-51b1a616-746b-407d-b982-7a35c6e788d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:32.614556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:32.650781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 447/888] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:32.913300 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f80c6-c24e-4991-a411-45446fad61de None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:32.947567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:33.029513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f80c6-c24e-4991-a411-45446fad61de None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:33.063876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c6a7b-6cd4-4ede-966a-3c514af6f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:33.064526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6a7b-6cd4-4ede-966a-3c514af6f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.064799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6a7b-6cd4-4ede-966a-3c514af6f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.065105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6a7b-6cd4-4ede-966a-3c514af6f6b3 None admin] PATH_INFO: `/v3/domains/1b86a838f6ae4dc7931e9ff47d3e65db` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.066254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c6a7b-6cd4-4ede-966a-3c514af6f6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1b86a838f6ae4dc7931e9ff47d3e65db)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:33.067681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c6a7b-6cd4-4ede-966a-3c514af6f6b3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:33.069270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 442/889] 10.222.0.15 () {56 vars in 1183 bytes} [Mon Oct 24 13:01:32 2022] GET /identity/v3/domains/1b86a838f6ae4dc7931e9ff47d3e65db => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:33.075950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a616-746b-407d-b982-7a35c6e788d5 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:33.184650 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a616-746b-407d-b982-7a35c6e788d5 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:33.342703 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab90e1-9082-41c6-aec6-0c5b449cd2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:33.343298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab90e1-9082-41c6-aec6-0c5b449cd2b5 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:33.343573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab90e1-9082-41c6-aec6-0c5b449cd2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:33.343842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab90e1-9082-41c6-aec6-0c5b449cd2b5 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:33.344516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab90e1-9082-41c6-aec6-0c5b449cd2b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:33.345919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab90e1-9082-41c6-aec6-0c5b449cd2b5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:33.371544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 448/890] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 13:01:33 2022] POST /identity/v3/users => generated 311 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:01:35.510660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccb10-1c58-4d16-af14-ed0a7dda5981 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:35.511238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccb10-1c58-4d16-af14-ed0a7dda5981 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:35.511238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ccb10-1c58-4d16-af14-ed0a7dda5981 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:35.513384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 443/891] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:35.522301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415effa-5bc6-43c8-9bd7-ebedf463fbf0 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:35.522703 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415effa-5bc6-43c8-9bd7-ebedf463fbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:35.522900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415effa-5bc6-43c8-9bd7-ebedf463fbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:35.545904 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a415effa-5bc6-43c8-9bd7-ebedf463fbf0 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:35.547223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a415effa-5bc6-43c8-9bd7-ebedf463fbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:35.567899 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:35.617814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 449/892] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:35.886784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccb10-1c58-4d16-af14-ed0a7dda5981 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:35.994482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:36.010907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ccb10-1c58-4d16-af14-ed0a7dda5981 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:36.050919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f664-11db-4cc2-82b6-d51f7c926456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:36.051545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f664-11db-4cc2-82b6-d51f7c926456 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.051819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f664-11db-4cc2-82b6-d51f7c926456 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.052088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f664-11db-4cc2-82b6-d51f7c926456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:36.063636 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486f664-11db-4cc2-82b6-d51f7c926456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-4486f664-11db-4cc2-82b6-d51f7c926456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:36.068531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:36.069666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:01:36.071011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 444/893] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:36.078629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415effa-5bc6-43c8-9bd7-ebedf463fbf0 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:36.177155 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415effa-5bc6-43c8-9bd7-ebedf463fbf0 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:36.211777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b358f1-9b91-4485-84ed-789faad9f86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:36.212396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b358f1-9b91-4485-84ed-789faad9f86b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.212665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b358f1-9b91-4485-84ed-789faad9f86b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.212926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b358f1-9b91-4485-84ed-789faad9f86b None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:36.213576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b358f1-9b91-4485-84ed-789faad9f86b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:36.213870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b358f1-9b91-4485-84ed-789faad9f86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:36.215231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b358f1-9b91-4485-84ed-789faad9f86b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:36.223240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 450/894] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:36.230516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f664-11db-4cc2-82b6-d51f7c926456 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:36.335019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f664-11db-4cc2-82b6-d51f7c926456 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:36.370548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc576c9-e7d0-4f7d-b2c9-35f3f854f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:36.371166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc576c9-e7d0-4f7d-b2c9-35f3f854f69f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.371440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc576c9-e7d0-4f7d-b2c9-35f3f854f69f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.371710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc576c9-e7d0-4f7d-b2c9-35f3f854f69f None admin] PATH_INFO: `/v3/users/d2571bd056e24494a77e74203bd70a31` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:36.385285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc576c9-e7d0-4f7d-b2c9-35f3f854f69f None admin] RBAC: Authorizing `identity:get_user(user_id=d2571bd056e24494a77e74203bd70a31)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:36.386720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc576c9-e7d0-4f7d-b2c9-35f3f854f69f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:36.388309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 445/895] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:36 2022] GET /identity/v3/users/d2571bd056e24494a77e74203bd70a31 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:36.394470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b358f1-9b91-4485-84ed-789faad9f86b None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:36.414234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:36.495006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b358f1-9b91-4485-84ed-789faad9f86b None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:36.529661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6d869-ed99-4da1-9535-9aa8524c44a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:36.530264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6d869-ed99-4da1-9535-9aa8524c44a4 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.530539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6d869-ed99-4da1-9535-9aa8524c44a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.530797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6d869-ed99-4da1-9535-9aa8524c44a4 None admin] PATH_INFO: `/v3/projects/4e5c01162b144e02bc40c64e8404c63f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:36.532044 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6d869-ed99-4da1-9535-9aa8524c44a4 None admin] RBAC: Authorizing `identity:get_project(project_id=4e5c01162b144e02bc40c64e8404c63f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:36.533493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6d869-ed99-4da1-9535-9aa8524c44a4 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:36.535132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 451/896] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 13:01:36 2022] GET /identity/v3/projects/4e5c01162b144e02bc40c64e8404c63f => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:36.541444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc576c9-e7d0-4f7d-b2c9-35f3f854f69f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:36.555124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:36.646270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc576c9-e7d0-4f7d-b2c9-35f3f854f69f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:36.681373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5550bb-bc56-4fc2-83d8-b973e707b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:36.682042 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5550bb-bc56-4fc2-83d8-b973e707b697 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:36.682308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5550bb-bc56-4fc2-83d8-b973e707b697 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:36.682578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5550bb-bc56-4fc2-83d8-b973e707b697 None admin] PATH_INFO: `/v3/projects/4e5c01162b144e02bc40c64e8404c63f/users/d2571bd056e24494a77e74203bd70a31/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:36.684735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5550bb-bc56-4fc2-83d8-b973e707b697 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e5c01162b144e02bc40c64e8404c63f, user_id=d2571bd056e24494a77e74203bd70a31, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:36.686160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5550bb-bc56-4fc2-83d8-b973e707b697 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:36.700955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 446/897] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:01:36 2022] PUT /identity/v3/projects/4e5c01162b144e02bc40c64e8404c63f/users/d2571bd056e24494a77e74203bd70a31/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:01:38.793093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4406ede-bcfe-4408-ab74-4fa4a28234da None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.793657 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4406ede-bcfe-4408-ab74-4fa4a28234da None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.793657 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4406ede-bcfe-4408-ab74-4fa4a28234da None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.794985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 452/898] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:01:38.801733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230f9d-4a7b-490d-a5f1-7ba52803c375 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:38.802487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230f9d-4a7b-490d-a5f1-7ba52803c375 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:38.802631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230f9d-4a7b-490d-a5f1-7ba52803c375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:38.832855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-50230f9d-4a7b-490d-a5f1-7ba52803c375 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:01:38.834028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-50230f9d-4a7b-490d-a5f1-7ba52803c375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:01:38.900757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:38.906324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 447/899] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:01:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:01:39.179541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4406ede-bcfe-4408-ab74-4fa4a28234da None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:39.271371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:39.290878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4406ede-bcfe-4408-ab74-4fa4a28234da None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:39.327254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfefd8-d2cd-4f7e-9168-e0686d31505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:39.327867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfefd8-d2cd-4f7e-9168-e0686d31505c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:39.328145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfefd8-d2cd-4f7e-9168-e0686d31505c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:39.328442 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfefd8-d2cd-4f7e-9168-e0686d31505c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:39.338314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfefd8-d2cd-4f7e-9168-e0686d31505c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-5dcfefd8-d2cd-4f7e-9168-e0686d31505c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:01:39.343112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:01:39.344181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:01:39.345257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 453/900] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:01:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:01:39.352500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50230f9d-4a7b-490d-a5f1-7ba52803c375 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:39.458123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50230f9d-4a7b-490d-a5f1-7ba52803c375 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:39.495213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7ce2-a60d-4418-abf2-4fb1063250e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:39.495807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7ce2-a60d-4418-abf2-4fb1063250e6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:39.496082 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7ce2-a60d-4418-abf2-4fb1063250e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:39.496354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7ce2-a60d-4418-abf2-4fb1063250e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:39.497387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7ce2-a60d-4418-abf2-4fb1063250e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:39.497686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7ce2-a60d-4418-abf2-4fb1063250e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:39.499061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7ce2-a60d-4418-abf2-4fb1063250e6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:39.507115 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 448/901] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:01:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:39.513722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfefd8-d2cd-4f7e-9168-e0686d31505c None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:39.618213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfefd8-d2cd-4f7e-9168-e0686d31505c None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:39.661276 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc7e9a-ba06-4e8f-b060-f98e85ed476b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:39.661896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc7e9a-ba06-4e8f-b060-f98e85ed476b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:39.662178 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc7e9a-ba06-4e8f-b060-f98e85ed476b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:39.662453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc7e9a-ba06-4e8f-b060-f98e85ed476b None admin] PATH_INFO: `/v3/users/d2571bd056e24494a77e74203bd70a31` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:39.663696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc7e9a-ba06-4e8f-b060-f98e85ed476b None admin] RBAC: Authorizing `identity:get_user(user_id=d2571bd056e24494a77e74203bd70a31)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:39.665172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc7e9a-ba06-4e8f-b060-f98e85ed476b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:39.666719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 454/902] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Oct 24 13:01:39 2022] GET /identity/v3/users/d2571bd056e24494a77e74203bd70a31 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:39.675230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7ce2-a60d-4418-abf2-4fb1063250e6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:39.741311 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:39.792483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7ce2-a60d-4418-abf2-4fb1063250e6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:39.827545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4161f-a949-4225-ab3d-23a98779590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:39.828144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4161f-a949-4225-ab3d-23a98779590c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:39.828435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4161f-a949-4225-ab3d-23a98779590c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:39.828708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4161f-a949-4225-ab3d-23a98779590c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:39.909642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4161f-a949-4225-ab3d-23a98779590c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:39.911099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4161f-a949-4225-ab3d-23a98779590c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:39.970988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:40.010803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 449/903] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:01:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 13:01:40.017676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc7e9a-ba06-4e8f-b060-f98e85ed476b None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:40.039783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:40.139649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc7e9a-ba06-4e8f-b060-f98e85ed476b None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:40.175611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52026cbb-f625-4f59-af7d-a4d2ec6c7661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:40.176620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52026cbb-f625-4f59-af7d-a4d2ec6c7661 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:40.177060 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52026cbb-f625-4f59-af7d-a4d2ec6c7661 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:40.177483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52026cbb-f625-4f59-af7d-a4d2ec6c7661 None admin] PATH_INFO: `/v3/projects/4e5c01162b144e02bc40c64e8404c63f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:40.179528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52026cbb-f625-4f59-af7d-a4d2ec6c7661 None admin] RBAC: Authorizing `identity:get_project(project_id=4e5c01162b144e02bc40c64e8404c63f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:40.181860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52026cbb-f625-4f59-af7d-a4d2ec6c7661 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:40.184556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 455/904] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Oct 24 13:01:40 2022] GET /identity/v3/projects/4e5c01162b144e02bc40c64e8404c63f => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:40.191047 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4161f-a949-4225-ab3d-23a98779590c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:01:40.291740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4161f-a949-4225-ab3d-23a98779590c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:01:40.326319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e518567-396b-45b3-a430-f77724b1c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:01:40.326913 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518567-396b-45b3-a430-f77724b1c91a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:01:40.327184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518567-396b-45b3-a430-f77724b1c91a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:01:40.327451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518567-396b-45b3-a430-f77724b1c91a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:01:40.328160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e518567-396b-45b3-a430-f77724b1c91a None admin] RBAC: Adding query filter params (role.id=67447f88528849c59df641acc7768c92, scope.project.id=4e5c01162b144e02bc40c64e8404c63f, user.id=d2571bd056e24494a77e74203bd70a31) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:01:40.328491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e518567-396b-45b3-a430-f77724b1c91a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:01:40.329897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e518567-396b-45b3-a430-f77724b1c91a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:01:40.335708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 450/905] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:01:40 2022] GET /identity/v3/role_assignments?user.id=d2571bd056e24494a77e74203bd70a31&scope.project.id=4e5c01162b144e02bc40c64e8404c63f&role.id=67447f88528849c59df641acc7768c92 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:01:50.169208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=59 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:01:50.333059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=87 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:35.842491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031253f-6f73-4746-b89d-27d879f8a45c None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:35.842491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031253f-6f73-4746-b89d-27d879f8a45c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:35.842491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031253f-6f73-4746-b89d-27d879f8a45c None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:35.843618 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 456/906] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:35.849805 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487a59f-a7bc-4391-9b94-219fbf0e9ece None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:35.850275 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487a59f-a7bc-4391-9b94-219fbf0e9ece None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:35.850394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487a59f-a7bc-4391-9b94-219fbf0e9ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:35.873946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-6487a59f-a7bc-4391-9b94-219fbf0e9ece None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:35.875171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6487a59f-a7bc-4391-9b94-219fbf0e9ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:35.959329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 451/907] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:36.243085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031253f-6f73-4746-b89d-27d879f8a45c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:36.380976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031253f-6f73-4746-b89d-27d879f8a45c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:36.425351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded24c0a-bc4e-414d-9942-27b0ffbb596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:36.426525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded24c0a-bc4e-414d-9942-27b0ffbb596d None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:36.427012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded24c0a-bc4e-414d-9942-27b0ffbb596d None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:36.427489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded24c0a-bc4e-414d-9942-27b0ffbb596d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:36.441171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded24c0a-bc4e-414d-9942-27b0ffbb596d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:36.443454 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded24c0a-bc4e-414d-9942-27b0ffbb596d None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-ded24c0a-bc4e-414d-9942-27b0ffbb596d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:02:36.462665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:36.464101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:02:36.465846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:02:36.465846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:36.465846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:36.467667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 457/908] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:36.475124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487a59f-a7bc-4391-9b94-219fbf0e9ece None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:36.595874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487a59f-a7bc-4391-9b94-219fbf0e9ece None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:36.627582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:36.635036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab1552-ea6e-4327-8460-2ba31f8dad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:36.635697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab1552-ea6e-4327-8460-2ba31f8dad80 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:36.635973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab1552-ea6e-4327-8460-2ba31f8dad80 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:36.636240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab1552-ea6e-4327-8460-2ba31f8dad80 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:36.636920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab1552-ea6e-4327-8460-2ba31f8dad80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:36.637239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab1552-ea6e-4327-8460-2ba31f8dad80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:36.638599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab1552-ea6e-4327-8460-2ba31f8dad80 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:36.650714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 452/909] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:36.656831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded24c0a-bc4e-414d-9942-27b0ffbb596d None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:36.728809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:36.787007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded24c0a-bc4e-414d-9942-27b0ffbb596d None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:36.827470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acba65-ec18-44f0-b7fc-a14eede594f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:36.828250 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acba65-ec18-44f0-b7fc-a14eede594f5 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:36.828652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acba65-ec18-44f0-b7fc-a14eede594f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:36.831213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acba65-ec18-44f0-b7fc-a14eede594f5 None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:36.832030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acba65-ec18-44f0-b7fc-a14eede594f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:36.833678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acba65-ec18-44f0-b7fc-a14eede594f5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:36.872812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 458/910] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Oct 24 13:02:36 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:02:39.257484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ead55-f74f-45d6-964e-2aed35dfb269 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:39.258148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ead55-f74f-45d6-964e-2aed35dfb269 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:39.258148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ead55-f74f-45d6-964e-2aed35dfb269 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:39.259603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 453/911] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:39.265882 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e988f-93a9-47e8-81b6-6ff8da6ca3c2 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:39.266568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e988f-93a9-47e8-81b6-6ff8da6ca3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:39.266568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e988f-93a9-47e8-81b6-6ff8da6ca3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:39.286369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-bc3e988f-93a9-47e8-81b6-6ff8da6ca3c2 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:39.287553 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bc3e988f-93a9-47e8-81b6-6ff8da6ca3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:39.360714 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 459/912] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:39.644783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ead55-f74f-45d6-964e-2aed35dfb269 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:39.765847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ead55-f74f-45d6-964e-2aed35dfb269 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:39.806072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ad6ec-b824-4769-a473-93f4398fc9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:39.806717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad6ec-b824-4769-a473-93f4398fc9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:39.806999 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad6ec-b824-4769-a473-93f4398fc9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:39.807268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad6ec-b824-4769-a473-93f4398fc9e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:39.819393 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ad6ec-b824-4769-a473-93f4398fc9e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-f59ad6ec-b824-4769-a473-93f4398fc9e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:02:39.824659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:39.825794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:39.826796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 454/913] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:02:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:39.832591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e988f-93a9-47e8-81b6-6ff8da6ca3c2 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:39.882888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:39.952642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e988f-93a9-47e8-81b6-6ff8da6ca3c2 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:39.990814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e2b92-8a76-495c-af2f-226e50496dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:39.991451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e2b92-8a76-495c-af2f-226e50496dde None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:39.991728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e2b92-8a76-495c-af2f-226e50496dde None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:39.992038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e2b92-8a76-495c-af2f-226e50496dde None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:39.992753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e2b92-8a76-495c-af2f-226e50496dde None admin] RBAC: Adding query filter params (name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:39.993102 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e2b92-8a76-495c-af2f-226e50496dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:39.994536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e2b92-8a76-495c-af2f-226e50496dde None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:40.004011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 460/914] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:02:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:40.010337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ad6ec-b824-4769-a473-93f4398fc9e9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:40.071666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:40.130968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ad6ec-b824-4769-a473-93f4398fc9e9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:40.172133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc68f16-2399-4898-b553-e02e953d3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:40.172949 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc68f16-2399-4898-b553-e02e953d3502 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:40.173352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc68f16-2399-4898-b553-e02e953d3502 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:40.173767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc68f16-2399-4898-b553-e02e953d3502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:40.188377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc68f16-2399-4898-b553-e02e953d3502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:40.192488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc68f16-2399-4898-b553-e02e953d3502 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-7dc68f16-2399-4898-b553-e02e953d3502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:02:40.208346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:40.209366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:02:40.215713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:02:40.215713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:40.215713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:40.215713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 455/915] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:40.216145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e2b92-8a76-495c-af2f-226e50496dde None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:40.324791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:40.329648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e2b92-8a76-495c-af2f-226e50496dde None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:40.371932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054f82c-8599-47b3-8ea2-e08118eb2cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:40.372636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054f82c-8599-47b3-8ea2-e08118eb2cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:40.372835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054f82c-8599-47b3-8ea2-e08118eb2cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:40.373125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054f82c-8599-47b3-8ea2-e08118eb2cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:40.373777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054f82c-8599-47b3-8ea2-e08118eb2cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:40.374073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054f82c-8599-47b3-8ea2-e08118eb2cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:40.375477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054f82c-8599-47b3-8ea2-e08118eb2cd3 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:40.388697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 461/916] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:40.393448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc68f16-2399-4898-b553-e02e953d3502 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:40.507105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc68f16-2399-4898-b553-e02e953d3502 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:40.509167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:40.551189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639567-66e5-4dd9-ac9c-a6dacfa24413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:40.552401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639567-66e5-4dd9-ac9c-a6dacfa24413 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:40.552697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639567-66e5-4dd9-ac9c-a6dacfa24413 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:40.552937 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639567-66e5-4dd9-ac9c-a6dacfa24413 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:40.562475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52639567-66e5-4dd9-ac9c-a6dacfa24413 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:40.564101 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52639567-66e5-4dd9-ac9c-a6dacfa24413 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-52639567-66e5-4dd9-ac9c-a6dacfa24413 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:02:40.576261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:40.577494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:40.578631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 456/917] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:40.584107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054f82c-8599-47b3-8ea2-e08118eb2cd3 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:40.696683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054f82c-8599-47b3-8ea2-e08118eb2cd3 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:40.731662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e569cc-691d-42b1-8639-c107afc29f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:40.732396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e569cc-691d-42b1-8639-c107afc29f4c None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:40.732746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e569cc-691d-42b1-8639-c107afc29f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:40.733092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e569cc-691d-42b1-8639-c107afc29f4c None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:40.733956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e569cc-691d-42b1-8639-c107afc29f4c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:40.734328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e569cc-691d-42b1-8639-c107afc29f4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:40.736005 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e569cc-691d-42b1-8639-c107afc29f4c None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:40.755432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 462/918] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Oct 24 13:02:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:40.761438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639567-66e5-4dd9-ac9c-a6dacfa24413 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:40.880724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639567-66e5-4dd9-ac9c-a6dacfa24413 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:40.921415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cc050-27be-4993-b6a9-60bf614f209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:40.922143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cc050-27be-4993-b6a9-60bf614f209a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:40.922424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cc050-27be-4993-b6a9-60bf614f209a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:40.922690 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cc050-27be-4993-b6a9-60bf614f209a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:40.933505 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cc050-27be-4993-b6a9-60bf614f209a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:40.934928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cc050-27be-4993-b6a9-60bf614f209a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-485cc050-27be-4993-b6a9-60bf614f209a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:02:40.952121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:40.953352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:02:40.954243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:02:40.954243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:40.954243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:40.954243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 457/919] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:40.959396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e569cc-691d-42b1-8639-c107afc29f4c None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:40.983589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:41.081870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e569cc-691d-42b1-8639-c107afc29f4c None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:41.127056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a35645-f9ae-40a7-bd3a-8bbc5b99efbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:41.128208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35645-f9ae-40a7-bd3a-8bbc5b99efbb None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:41.128698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35645-f9ae-40a7-bd3a-8bbc5b99efbb None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:41.129020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35645-f9ae-40a7-bd3a-8bbc5b99efbb None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:41.129665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a35645-f9ae-40a7-bd3a-8bbc5b99efbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:41.130027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a35645-f9ae-40a7-bd3a-8bbc5b99efbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:41.131458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a35645-f9ae-40a7-bd3a-8bbc5b99efbb None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:41.143897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 463/920] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:41.150425 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cc050-27be-4993-b6a9-60bf614f209a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:41.172985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:41.268224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cc050-27be-4993-b6a9-60bf614f209a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:41.307805 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f31b8-df52-4436-afdb-29359514d62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:41.308474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f31b8-df52-4436-afdb-29359514d62e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:41.308751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f31b8-df52-4436-afdb-29359514d62e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:41.309022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f31b8-df52-4436-afdb-29359514d62e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:41.317707 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f31b8-df52-4436-afdb-29359514d62e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:41.319163 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f31b8-df52-4436-afdb-29359514d62e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-ac7f31b8-df52-4436-afdb-29359514d62e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:02:41.330135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:41.331177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:41.332264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:02:41.332264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:02:41.332264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:02:41.332264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:02:41.332264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:02:41.332264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:02:41.332264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:02:41.332264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:41.337759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 458/921] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:41.337915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a35645-f9ae-40a7-bd3a-8bbc5b99efbb None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:41.420899 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:41.443517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a35645-f9ae-40a7-bd3a-8bbc5b99efbb None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:41.481966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4d951-1f01-4d46-8dab-1e082aa31e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:41.482587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4d951-1f01-4d46-8dab-1e082aa31e12 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:41.482866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4d951-1f01-4d46-8dab-1e082aa31e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:41.483137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4d951-1f01-4d46-8dab-1e082aa31e12 None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:41.483841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4d951-1f01-4d46-8dab-1e082aa31e12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:41.484146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4d951-1f01-4d46-8dab-1e082aa31e12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:41.485652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4d951-1f01-4d46-8dab-1e082aa31e12 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:41.498672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 464/922] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:41.505343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f31b8-df52-4436-afdb-29359514d62e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:41.596021 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:41.625634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f31b8-df52-4436-afdb-29359514d62e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:41.660494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ef75b-f6a0-468a-a788-fca5105ead52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:41.661212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ef75b-f6a0-468a-a788-fca5105ead52 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:41.661443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ef75b-f6a0-468a-a788-fca5105ead52 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:41.661823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ef75b-f6a0-468a-a788-fca5105ead52 None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/3a25b60f83d84fb38a759d6620c1c58c/roles/44dc9e93541449b6b5f221c79be8b938` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:41.676915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ef75b-f6a0-468a-a788-fca5105ead52 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=3a25b60f83d84fb38a759d6620c1c58c, role_id=44dc9e93541449b6b5f221c79be8b938)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:41.678364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ef75b-f6a0-468a-a788-fca5105ead52 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:41.691134 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 459/923] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:02:41 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/3a25b60f83d84fb38a759d6620c1c58c/roles/44dc9e93541449b6b5f221c79be8b938 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:02:43.806327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae9d25-2f6f-481c-8e21-e0f0b25c5d2d None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:43.806913 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae9d25-2f6f-481c-8e21-e0f0b25c5d2d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:43.806913 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae9d25-2f6f-481c-8e21-e0f0b25c5d2d None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:43.808232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 465/924] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:43.813851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f177d-5ee4-48df-8f38-fff1c7cba867 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:43.814343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f177d-5ee4-48df-8f38-fff1c7cba867 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:43.814461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f177d-5ee4-48df-8f38-fff1c7cba867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:43.833129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9c3f177d-5ee4-48df-8f38-fff1c7cba867 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:43.834372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9c3f177d-5ee4-48df-8f38-fff1c7cba867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:43.907252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 460/925] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:44.172633 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae9d25-2f6f-481c-8e21-e0f0b25c5d2d None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:44.289114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae9d25-2f6f-481c-8e21-e0f0b25c5d2d None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:44.327156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffd64a-2284-4cb3-a403-ea9b117d4993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:44.327955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffd64a-2284-4cb3-a403-ea9b117d4993 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:44.328254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffd64a-2284-4cb3-a403-ea9b117d4993 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:44.328558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffd64a-2284-4cb3-a403-ea9b117d4993 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:44.336316 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:44.340973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffd64a-2284-4cb3-a403-ea9b117d4993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-e7ffd64a-2284-4cb3-a403-ea9b117d4993 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:02:44.346244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:44.347370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:44.348258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 466/926] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Oct 24 13:02:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:44.353635 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f177d-5ee4-48df-8f38-fff1c7cba867 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:44.416118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:44.476743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f177d-5ee4-48df-8f38-fff1c7cba867 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:44.516824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d5e04-545b-4d6a-9115-c1d490a4c7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:44.517534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d5e04-545b-4d6a-9115-c1d490a4c7ff None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:44.517815 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d5e04-545b-4d6a-9115-c1d490a4c7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:44.518091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d5e04-545b-4d6a-9115-c1d490a4c7ff None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:44.518907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d5e04-545b-4d6a-9115-c1d490a4c7ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:44.519537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d5e04-545b-4d6a-9115-c1d490a4c7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:44.521937 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d5e04-545b-4d6a-9115-c1d490a4c7ff None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:44.534026 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 461/927] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Oct 24 13:02:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:44.540174 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffd64a-2284-4cb3-a403-ea9b117d4993 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:44.656601 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffd64a-2284-4cb3-a403-ea9b117d4993 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:44.691958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7bce9-8630-49e4-b1a9-d688f2efb8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:44.692668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7bce9-8630-49e4-b1a9-d688f2efb8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:44.692883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7bce9-8630-49e4-b1a9-d688f2efb8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:44.693145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7bce9-8630-49e4-b1a9-d688f2efb8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:44.704695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7bce9-8630-49e4-b1a9-d688f2efb8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:44.706195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7bce9-8630-49e4-b1a9-d688f2efb8e1 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-50b7bce9-8630-49e4-b1a9-d688f2efb8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:02:44.720172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:44.721450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:02:44.722508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:02:44.722508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:44.722508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:44.722508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 467/928] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:44.727416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d5e04-545b-4d6a-9115-c1d490a4c7ff None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:44.833972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d5e04-545b-4d6a-9115-c1d490a4c7ff None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:44.853980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:44.874487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e8a5c-ec23-45b8-8631-921bab4005bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:44.875362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8a5c-ec23-45b8-8631-921bab4005bf None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:44.875671 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8a5c-ec23-45b8-8631-921bab4005bf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:44.876077 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8a5c-ec23-45b8-8631-921bab4005bf None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:44.876846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e8a5c-ec23-45b8-8631-921bab4005bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:44.877153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e8a5c-ec23-45b8-8631-921bab4005bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:44.878789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e8a5c-ec23-45b8-8631-921bab4005bf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:44.891657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 462/929] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:02:44.897517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7bce9-8630-49e4-b1a9-d688f2efb8e1 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:44.952424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:45.002635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7bce9-8630-49e4-b1a9-d688f2efb8e1 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:45.034735 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2c21e-d33b-4946-ae51-244738807b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:45.035370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2c21e-d33b-4946-ae51-244738807b80 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:45.035649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2c21e-d33b-4946-ae51-244738807b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:45.035917 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2c21e-d33b-4946-ae51-244738807b80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:45.043384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2c21e-d33b-4946-ae51-244738807b80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:45.044832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2c21e-d33b-4946-ae51-244738807b80 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-5ac2c21e-d33b-4946-ae51-244738807b80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:02:45.055850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:45.056925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:45.057895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 468/930] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:45.063105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e8a5c-ec23-45b8-8631-921bab4005bf None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:45.167786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e8a5c-ec23-45b8-8631-921bab4005bf None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:45.204594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56ae27-10d7-46f2-92ab-1ca06e0a3248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:45.205516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56ae27-10d7-46f2-92ab-1ca06e0a3248 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:45.205860 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56ae27-10d7-46f2-92ab-1ca06e0a3248 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:45.206191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56ae27-10d7-46f2-92ab-1ca06e0a3248 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:45.207020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56ae27-10d7-46f2-92ab-1ca06e0a3248 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:45.207438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56ae27-10d7-46f2-92ab-1ca06e0a3248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:45.209018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56ae27-10d7-46f2-92ab-1ca06e0a3248 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:45.232838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 463/931] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Oct 24 13:02:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:45.234282 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2c21e-d33b-4946-ae51-244738807b80 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:45.335994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2c21e-d33b-4946-ae51-244738807b80 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:45.346141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:45.369949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7ebd0-089e-46a4-99cd-185dc17c8dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:45.370978 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7ebd0-089e-46a4-99cd-185dc17c8dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:45.371255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7ebd0-089e-46a4-99cd-185dc17c8dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:45.371519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7ebd0-089e-46a4-99cd-185dc17c8dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:45.442306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7ebd0-089e-46a4-99cd-185dc17c8dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:45.443754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7ebd0-089e-46a4-99cd-185dc17c8dc0 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:45.551070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 469/932] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:02:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 13:02:45.557118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56ae27-10d7-46f2-92ab-1ca06e0a3248 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:45.592361 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:45.659875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56ae27-10d7-46f2-92ab-1ca06e0a3248 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:45.694532 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddec4c-532b-451f-9c60-d2dc5fa53cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:45.695162 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddec4c-532b-451f-9c60-d2dc5fa53cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:45.695430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddec4c-532b-451f-9c60-d2dc5fa53cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:45.695698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddec4c-532b-451f-9c60-d2dc5fa53cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:45.705868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddec4c-532b-451f-9c60-d2dc5fa53cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:45.707315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddec4c-532b-451f-9c60-d2dc5fa53cd9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-9dddec4c-532b-451f-9c60-d2dc5fa53cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:02:45.721885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:45.727928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:02:45.729084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:02:45.729084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:45.729084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:45.729084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 464/933] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:02:45.729359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7ebd0-089e-46a4-99cd-185dc17c8dc0 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:45.740778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:45.838755 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7ebd0-089e-46a4-99cd-185dc17c8dc0 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:45.878252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98bc51-040f-4f8e-8c16-00afac001313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:45.878869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98bc51-040f-4f8e-8c16-00afac001313 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:45.879145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98bc51-040f-4f8e-8c16-00afac001313 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:45.879409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98bc51-040f-4f8e-8c16-00afac001313 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:45.880053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98bc51-040f-4f8e-8c16-00afac001313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:45.880383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98bc51-040f-4f8e-8c16-00afac001313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:45.881758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98bc51-040f-4f8e-8c16-00afac001313 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:45.895210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 470/934] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:45.901377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddec4c-532b-451f-9c60-d2dc5fa53cd9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:45.998662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:46.014533 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddec4c-532b-451f-9c60-d2dc5fa53cd9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:46.051232 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f80cc5-a0d7-483b-a9bc-2f1dc4956f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:46.051883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f80cc5-a0d7-483b-a9bc-2f1dc4956f3e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:46.052142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f80cc5-a0d7-483b-a9bc-2f1dc4956f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:46.052441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f80cc5-a0d7-483b-a9bc-2f1dc4956f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:46.058998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f80cc5-a0d7-483b-a9bc-2f1dc4956f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:46.060466 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f80cc5-a0d7-483b-a9bc-2f1dc4956f3e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-27f80cc5-a0d7-483b-a9bc-2f1dc4956f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:02:46.071451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:46.072590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:46.073626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:02:46.073626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:02:46.073626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:02:46.073626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:02:46.073626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:02:46.073626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:02:46.073626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:02:46.073626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:46.073626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 465/935] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:46.078883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98bc51-040f-4f8e-8c16-00afac001313 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:46.153672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:46.186299 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98bc51-040f-4f8e-8c16-00afac001313 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:46.221374 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4f617-36a3-46a5-a858-ac688941f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:46.221990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f617-36a3-46a5-a858-ac688941f971 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:46.222256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f617-36a3-46a5-a858-ac688941f971 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:46.222525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f617-36a3-46a5-a858-ac688941f971 None admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:46.223216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4f617-36a3-46a5-a858-ac688941f971 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:46.223516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4f617-36a3-46a5-a858-ac688941f971 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:46.224980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4f617-36a3-46a5-a858-ac688941f971 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:46.237206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 471/936] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:46.243839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f80cc5-a0d7-483b-a9bc-2f1dc4956f3e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:46.352241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f80cc5-a0d7-483b-a9bc-2f1dc4956f3e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:46.387844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3553767-f8a8-450f-9666-4bdb9be11f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:46.388503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553767-f8a8-450f-9666-4bdb9be11f4c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:46.388782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553767-f8a8-450f-9666-4bdb9be11f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:46.389029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553767-f8a8-450f-9666-4bdb9be11f4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:46.389756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3553767-f8a8-450f-9666-4bdb9be11f4c None admin] RBAC: Adding query filter params (role.id=44dc9e93541449b6b5f221c79be8b938, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=3a25b60f83d84fb38a759d6620c1c58c) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:46.390056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3553767-f8a8-450f-9666-4bdb9be11f4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:46.391483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3553767-f8a8-450f-9666-4bdb9be11f4c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:46.397520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 466/937] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:02:46 2022] GET /identity/v3/role_assignments?user.id=3a25b60f83d84fb38a759d6620c1c58c&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=44dc9e93541449b6b5f221c79be8b938 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:48.600152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf3764-4490-42ac-8756-b87cd9df9e8a None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:48.600793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf3764-4490-42ac-8756-b87cd9df9e8a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:48.600793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf3764-4490-42ac-8756-b87cd9df9e8a None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:48.602068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 472/938] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:48.607572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb03fa-1efd-4811-807f-9b77a45a4351 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:48.608005 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb03fa-1efd-4811-807f-9b77a45a4351 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:48.608118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb03fa-1efd-4811-807f-9b77a45a4351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:48.627973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b3eb03fa-1efd-4811-807f-9b77a45a4351 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:48.629199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b3eb03fa-1efd-4811-807f-9b77a45a4351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:48.632122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:48.697845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 467/939] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 13:02:48.956381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf3764-4490-42ac-8756-b87cd9df9e8a None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:49.056684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf3764-4490-42ac-8756-b87cd9df9e8a None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:49.085515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:49.092950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565332fb-7e54-4f13-ad34-b273f7a2189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:49.093587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565332fb-7e54-4f13-ad34-b273f7a2189a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:49.093865 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565332fb-7e54-4f13-ad34-b273f7a2189a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:49.094127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565332fb-7e54-4f13-ad34-b273f7a2189a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:49.104668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565332fb-7e54-4f13-ad34-b273f7a2189a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-565332fb-7e54-4f13-ad34-b273f7a2189a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:02:49.110498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:49.111573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:49.112864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 473/940] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:49.118128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb03fa-1efd-4811-807f-9b77a45a4351 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:49.222912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb03fa-1efd-4811-807f-9b77a45a4351 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:49.263423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38945ace-227c-4b42-b418-fa65dd817844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:49.264032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38945ace-227c-4b42-b418-fa65dd817844 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:49.264318 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38945ace-227c-4b42-b418-fa65dd817844 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:49.264593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38945ace-227c-4b42-b418-fa65dd817844 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:49.265254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38945ace-227c-4b42-b418-fa65dd817844 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:49.265627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38945ace-227c-4b42-b418-fa65dd817844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:49.267208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38945ace-227c-4b42-b418-fa65dd817844 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:49.276550 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 468/941] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:02:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:49.282504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565332fb-7e54-4f13-ad34-b273f7a2189a None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:49.390009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565332fb-7e54-4f13-ad34-b273f7a2189a None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:49.428375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dbce1-a930-4d5b-b7fe-373cb65a56db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:49.429007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dbce1-a930-4d5b-b7fe-373cb65a56db None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:49.429284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dbce1-a930-4d5b-b7fe-373cb65a56db None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:49.429551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dbce1-a930-4d5b-b7fe-373cb65a56db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:49.441731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920dbce1-a930-4d5b-b7fe-373cb65a56db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:49.443255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920dbce1-a930-4d5b-b7fe-373cb65a56db None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-920dbce1-a930-4d5b-b7fe-373cb65a56db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:02:49.460092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:49.461330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:02:49.462303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:02:49.462303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:49.462303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:49.462303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 474/942] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:49.467559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38945ace-227c-4b42-b418-fa65dd817844 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:49.470622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:49.582656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38945ace-227c-4b42-b418-fa65dd817844 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:49.618016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6288b-a04c-4826-8029-81fc8033526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:49.618707 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6288b-a04c-4826-8029-81fc8033526b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:49.618947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6288b-a04c-4826-8029-81fc8033526b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:49.619243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6288b-a04c-4826-8029-81fc8033526b None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:49.619978 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6288b-a04c-4826-8029-81fc8033526b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:49.620746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6288b-a04c-4826-8029-81fc8033526b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:49.622308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6288b-a04c-4826-8029-81fc8033526b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:49.634807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 469/943] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:49.640680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dbce1-a930-4d5b-b7fe-373cb65a56db None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:49.690461 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:49.753254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dbce1-a930-4d5b-b7fe-373cb65a56db None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:49.788563 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b225eb8-ed95-4d65-85d9-4185ead981ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:49.789201 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b225eb8-ed95-4d65-85d9-4185ead981ab None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:49.789480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b225eb8-ed95-4d65-85d9-4185ead981ab None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:49.789770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b225eb8-ed95-4d65-85d9-4185ead981ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:49.797188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b225eb8-ed95-4d65-85d9-4185ead981ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:49.798768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b225eb8-ed95-4d65-85d9-4185ead981ab None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-0b225eb8-ed95-4d65-85d9-4185ead981ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:02:49.809656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:49.810695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:49.811623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 475/944] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:49.816744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6288b-a04c-4826-8029-81fc8033526b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:49.887156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:49.936792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6288b-a04c-4826-8029-81fc8033526b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:49.974389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b1570-e766-4e96-a9cd-56389a8928d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:49.975001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b1570-e766-4e96-a9cd-56389a8928d8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:49.975287 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b1570-e766-4e96-a9cd-56389a8928d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:49.975582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b1570-e766-4e96-a9cd-56389a8928d8 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:49.976275 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b1570-e766-4e96-a9cd-56389a8928d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:49.976630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b1570-e766-4e96-a9cd-56389a8928d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:49.978036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b1570-e766-4e96-a9cd-56389a8928d8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:49.997368 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 470/945] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Oct 24 13:02:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:50.004151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b225eb8-ed95-4d65-85d9-4185ead981ab None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:50.106775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b225eb8-ed95-4d65-85d9-4185ead981ab None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:50.108457 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:50.144806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0ac5f-9c56-4008-ae7f-fb331cb50611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:50.145478 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ac5f-9c56-4008-ae7f-fb331cb50611 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:50.145814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ac5f-9c56-4008-ae7f-fb331cb50611 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:50.146117 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ac5f-9c56-4008-ae7f-fb331cb50611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:50.157050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0ac5f-9c56-4008-ae7f-fb331cb50611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:50.158758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0ac5f-9c56-4008-ae7f-fb331cb50611 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-8aa0ac5f-9c56-4008-ae7f-fb331cb50611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:02:50.173000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:50.174190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:02:50.175456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:02:50.175456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:50.175456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:50.175456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 476/946] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:50.180242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b1570-e766-4e96-a9cd-56389a8928d8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:50.288708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b1570-e766-4e96-a9cd-56389a8928d8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:50.310370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:50.325282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21395632-6b75-457e-8492-941c23ea546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:50.325890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21395632-6b75-457e-8492-941c23ea546a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:50.326164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21395632-6b75-457e-8492-941c23ea546a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:50.326478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21395632-6b75-457e-8492-941c23ea546a None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:50.327182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21395632-6b75-457e-8492-941c23ea546a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:50.327497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21395632-6b75-457e-8492-941c23ea546a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:50.329038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21395632-6b75-457e-8492-941c23ea546a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:50.342620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 471/947] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:50.348526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0ac5f-9c56-4008-ae7f-fb331cb50611 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:50.456705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0ac5f-9c56-4008-ae7f-fb331cb50611 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:50.495924 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9198b4-91a1-4f2d-9a3d-541b8d6c5f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:50.496729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9198b4-91a1-4f2d-9a3d-541b8d6c5f06 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:50.496994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9198b4-91a1-4f2d-9a3d-541b8d6c5f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:50.497256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9198b4-91a1-4f2d-9a3d-541b8d6c5f06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:50.504983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9198b4-91a1-4f2d-9a3d-541b8d6c5f06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:50.506569 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9198b4-91a1-4f2d-9a3d-541b8d6c5f06 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-bb9198b4-91a1-4f2d-9a3d-541b8d6c5f06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:02:50.520210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:50.521645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:50.523203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:02:50.523203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:02:50.523203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:02:50.523203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:02:50.523203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:02:50.523203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:02:50.523203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:02:50.523203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:50.523203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 477/948] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:50.528140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21395632-6b75-457e-8492-941c23ea546a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:50.633842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21395632-6b75-457e-8492-941c23ea546a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:50.669403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7831cec-4558-4014-8faa-19b8e0ea91d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:50.670206 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7831cec-4558-4014-8faa-19b8e0ea91d0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:50.670489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7831cec-4558-4014-8faa-19b8e0ea91d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:50.670773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7831cec-4558-4014-8faa-19b8e0ea91d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:50.671450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7831cec-4558-4014-8faa-19b8e0ea91d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:50.671756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7831cec-4558-4014-8faa-19b8e0ea91d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:50.673279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7831cec-4558-4014-8faa-19b8e0ea91d0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:50.685817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 472/949] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:50.691969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9198b4-91a1-4f2d-9a3d-541b8d6c5f06 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:50.709974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:50.803711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9198b4-91a1-4f2d-9a3d-541b8d6c5f06 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:50.838758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867a300-9ad3-4ff6-975e-a5ee586a71b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:50.839425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867a300-9ad3-4ff6-975e-a5ee586a71b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:50.839697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867a300-9ad3-4ff6-975e-a5ee586a71b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:50.840005 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867a300-9ad3-4ff6-975e-a5ee586a71b5 None admin] PATH_INFO: `/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/3a25b60f83d84fb38a759d6620c1c58c/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:50.844433 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867a300-9ad3-4ff6-975e-a5ee586a71b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24d177141b44fbca74b3aa6878becf9, user_id=3a25b60f83d84fb38a759d6620c1c58c, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:50.845964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867a300-9ad3-4ff6-975e-a5ee586a71b5 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:50.861602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 478/950] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Oct 24 13:02:50 2022] PUT /identity/v3/projects/f24d177141b44fbca74b3aa6878becf9/users/3a25b60f83d84fb38a759d6620c1c58c/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:02:53.176725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5d66e-22a3-4bb2-b3b9-efdc5fc00d86 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:53.177330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5d66e-22a3-4bb2-b3b9-efdc5fc00d86 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:53.177330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5d66e-22a3-4bb2-b3b9-efdc5fc00d86 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:53.178629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 473/951] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:02:53.184310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694d8f9-20b2-4182-9627-d6df28871af9 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:53.184777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694d8f9-20b2-4182-9627-d6df28871af9 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:53.184885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694d8f9-20b2-4182-9627-d6df28871af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:53.204175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a694d8f9-20b2-4182-9627-d6df28871af9 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:53.205537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a694d8f9-20b2-4182-9627-d6df28871af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:53.278203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 479/952] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:53.562164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5d66e-22a3-4bb2-b3b9-efdc5fc00d86 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:53.611811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:53.676375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5d66e-22a3-4bb2-b3b9-efdc5fc00d86 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:53.717433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba8bd2-886e-4bb1-b3bd-61176023f512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:53.718150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba8bd2-886e-4bb1-b3bd-61176023f512 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:53.718412 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba8bd2-886e-4bb1-b3bd-61176023f512 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:53.718752 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba8bd2-886e-4bb1-b3bd-61176023f512 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:53.731019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba8bd2-886e-4bb1-b3bd-61176023f512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-edba8bd2-886e-4bb1-b3bd-61176023f512 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 13:02:53.736172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:53.737254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 13:02:53.738106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:53.743163 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 474/953] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Oct 24 13:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:53.744380 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694d8f9-20b2-4182-9627-d6df28871af9 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:53.748399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:53.850184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694d8f9-20b2-4182-9627-d6df28871af9 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:53.891302 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f1b50-b9fe-435c-bcf3-d27445dfcd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:53.892084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f1b50-b9fe-435c-bcf3-d27445dfcd4e None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:53.892384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f1b50-b9fe-435c-bcf3-d27445dfcd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:53.892744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f1b50-b9fe-435c-bcf3-d27445dfcd4e None admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:53.893410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f1b50-b9fe-435c-bcf3-d27445dfcd4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:53.893788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f1b50-b9fe-435c-bcf3-d27445dfcd4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:53.895191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f1b50-b9fe-435c-bcf3-d27445dfcd4e None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:53.904167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 480/954] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Oct 24 13:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:53.910331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba8bd2-886e-4bb1-b3bd-61176023f512 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:54.018299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:54.021616 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba8bd2-886e-4bb1-b3bd-61176023f512 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:54.058056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9fbf-6270-4f66-a87b-8e5d17e7e0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:54.058698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9fbf-6270-4f66-a87b-8e5d17e7e0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:54.058977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9fbf-6270-4f66-a87b-8e5d17e7e0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:54.059239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9fbf-6270-4f66-a87b-8e5d17e7e0a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:54.069808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e9fbf-6270-4f66-a87b-8e5d17e7e0a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:54.071307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e9fbf-6270-4f66-a87b-8e5d17e7e0a0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-956e9fbf-6270-4f66-a87b-8e5d17e7e0a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:02:54.086992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:54.088177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:02:54.089251 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:02:54.089251 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:54.089251 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:54.089251 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 475/955] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:54.094439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f1b50-b9fe-435c-bcf3-d27445dfcd4e None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:54.163136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:54.203664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f1b50-b9fe-435c-bcf3-d27445dfcd4e None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:54.238544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb849571-37fa-44e0-91c5-11a5876b9d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:54.239153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb849571-37fa-44e0-91c5-11a5876b9d49 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:54.239477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb849571-37fa-44e0-91c5-11a5876b9d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:54.239717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb849571-37fa-44e0-91c5-11a5876b9d49 None admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:54.240513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb849571-37fa-44e0-91c5-11a5876b9d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:54.240812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb849571-37fa-44e0-91c5-11a5876b9d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:54.242281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb849571-37fa-44e0-91c5-11a5876b9d49 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:54.254789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 481/956] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:54.260740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9fbf-6270-4f66-a87b-8e5d17e7e0a0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:54.366741 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9fbf-6270-4f66-a87b-8e5d17e7e0a0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:54.404122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc7846-0621-4038-addf-a9e9002567f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:54.404907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc7846-0621-4038-addf-a9e9002567f9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:54.405271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc7846-0621-4038-addf-a9e9002567f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:54.405642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc7846-0621-4038-addf-a9e9002567f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:54.414901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc7846-0621-4038-addf-a9e9002567f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:54.416687 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc7846-0621-4038-addf-a9e9002567f9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-5fdc7846-0621-4038-addf-a9e9002567f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 13:02:54.431230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:54.432444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:54.439415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 476/957] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:54.441247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb849571-37fa-44e0-91c5-11a5876b9d49 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:54.558635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb849571-37fa-44e0-91c5-11a5876b9d49 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:54.590406 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:54.600710 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992b446-ccf7-4a5b-8449-c2d07f58e9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:54.601600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992b446-ccf7-4a5b-8449-c2d07f58e9be None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:54.601940 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992b446-ccf7-4a5b-8449-c2d07f58e9be None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:54.602216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992b446-ccf7-4a5b-8449-c2d07f58e9be None admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:54.602955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992b446-ccf7-4a5b-8449-c2d07f58e9be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:54.603259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992b446-ccf7-4a5b-8449-c2d07f58e9be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:54.604760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992b446-ccf7-4a5b-8449-c2d07f58e9be None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:54.624010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 482/958] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Oct 24 13:02:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:02:54.630125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc7846-0621-4038-addf-a9e9002567f9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:54.646913 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:54.736247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc7846-0621-4038-addf-a9e9002567f9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:54.771298 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b2af4-524c-425e-a5ff-2ce480cb5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:54.771918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b2af4-524c-425e-a5ff-2ce480cb5979 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:54.772193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b2af4-524c-425e-a5ff-2ce480cb5979 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:54.772564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b2af4-524c-425e-a5ff-2ce480cb5979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:54.842653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b2af4-524c-425e-a5ff-2ce480cb5979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:54.843002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b2af4-524c-425e-a5ff-2ce480cb5979 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:54.858819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:54.946491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 477/959] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Oct 24 13:02:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 13:02:54.952683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992b446-ccf7-4a5b-8449-c2d07f58e9be None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:55.058890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992b446-ccf7-4a5b-8449-c2d07f58e9be None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:55.097920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8962102-34df-445e-9820-c8f906c6a5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:55.098562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8962102-34df-445e-9820-c8f906c6a5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:55.098839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8962102-34df-445e-9820-c8f906c6a5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:55.099107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8962102-34df-445e-9820-c8f906c6a5c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:55.111282 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8962102-34df-445e-9820-c8f906c6a5c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:55.112824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8962102-34df-445e-9820-c8f906c6a5c8 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-a8962102-34df-445e-9820-c8f906c6a5c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 13:02:55.130231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:55.131331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 13:02:55.132322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 13:02:55.132322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 13:02:55.132322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:55.132322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 483/960] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:55.137765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b2af4-524c-425e-a5ff-2ce480cb5979 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:55.242588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b2af4-524c-425e-a5ff-2ce480cb5979 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:55.257471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:55.280509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8c1d8-a04e-417e-a534-1011bd3f4961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:55.281168 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8c1d8-a04e-417e-a534-1011bd3f4961 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:55.281426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8c1d8-a04e-417e-a534-1011bd3f4961 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:55.281760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8c1d8-a04e-417e-a534-1011bd3f4961 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:55.282519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8c1d8-a04e-417e-a534-1011bd3f4961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:55.282916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8c1d8-a04e-417e-a534-1011bd3f4961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:55.284318 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8c1d8-a04e-417e-a534-1011bd3f4961 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:55.296986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 478/961] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Oct 24 13:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:02:55.303484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8962102-34df-445e-9820-c8f906c6a5c8 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:55.350719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:55.422288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8962102-34df-445e-9820-c8f906c6a5c8 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:55.458600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea9dae-193e-4da3-8310-be0265e4eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:55.459251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea9dae-193e-4da3-8310-be0265e4eb1a None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:55.459527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea9dae-193e-4da3-8310-be0265e4eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:55.459794 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea9dae-193e-4da3-8310-be0265e4eb1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:55.467207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea9dae-193e-4da3-8310-be0265e4eb1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:55.468730 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea9dae-193e-4da3-8310-be0265e4eb1a None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application [None req-a6ea9dae-193e-4da3-8310-be0265e4eb1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 13:02:55.481137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:55.482134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:55.483026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 13:02:55.483026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 13:02:55.483026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 13:02:55.483026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 13:02:55.483026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 13:02:55.483026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 13:02:55.483026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 13:02:55.483026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: ERROR keystone.server.flask.application Oct 24 13:02:55.483026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 484/962] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Oct 24 13:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:02:55.488917 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8c1d8-a04e-417e-a534-1011bd3f4961 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:55.601409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8c1d8-a04e-417e-a534-1011bd3f4961 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:55.638023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdcc6b-6095-40c7-8eba-c6cfb65dd36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:55.638648 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdcc6b-6095-40c7-8eba-c6cfb65dd36c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:55.638923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdcc6b-6095-40c7-8eba-c6cfb65dd36c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:55.639187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdcc6b-6095-40c7-8eba-c6cfb65dd36c None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:55.639888 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdcc6b-6095-40c7-8eba-c6cfb65dd36c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:55.640185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdcc6b-6095-40c7-8eba-c6cfb65dd36c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:55.641675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdcc6b-6095-40c7-8eba-c6cfb65dd36c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:55.655543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 479/963] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Oct 24 13:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:55.661951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea9dae-193e-4da3-8310-be0265e4eb1a None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:55.762105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:55.769120 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea9dae-193e-4da3-8310-be0265e4eb1a None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:55.801968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6de479-fe81-4c16-8049-5111dcb6e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:55.802563 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6de479-fe81-4c16-8049-5111dcb6e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:55.802836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6de479-fe81-4c16-8049-5111dcb6e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:55.803106 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6de479-fe81-4c16-8049-5111dcb6e6d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:55.803828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6de479-fe81-4c16-8049-5111dcb6e6d2 None admin] RBAC: Adding query filter params (role.id=67447f88528849c59df641acc7768c92, scope.project.id=f24d177141b44fbca74b3aa6878becf9, user.id=3a25b60f83d84fb38a759d6620c1c58c) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:55.804134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6de479-fe81-4c16-8049-5111dcb6e6d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:55.805603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6de479-fe81-4c16-8049-5111dcb6e6d2 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:55.811286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 485/964] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Oct 24 13:02:55 2022] GET /identity/v3/role_assignments?user.id=3a25b60f83d84fb38a759d6620c1c58c&scope.project.id=f24d177141b44fbca74b3aa6878becf9&role.id=67447f88528849c59df641acc7768c92 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:57.928597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3511-2ded-4338-9a7a-28d5c2ffe386 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:57.929423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3511-2ded-4338-9a7a-28d5c2ffe386 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:57.929423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3511-2ded-4338-9a7a-28d5c2ffe386 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:57.931704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 480/965] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:02:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:02:57.940740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3726c3-2e7c-4156-bb72-f20431055b0b None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:57.941155 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3726c3-2e7c-4156-bb72-f20431055b0b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:57.941388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3726c3-2e7c-4156-bb72-f20431055b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:57.965629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-2f3726c3-2e7c-4156-bb72-f20431055b0b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:02:57.966845 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2f3726c3-2e7c-4156-bb72-f20431055b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:02:58.035706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 486/966] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:02:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:02:58.305491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c3511-2ded-4338-9a7a-28d5c2ffe386 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:58.345051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:58.437913 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c3511-2ded-4338-9a7a-28d5c2ffe386 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:58.477948 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246bc14-46c6-4805-b9c6-8c1ed9df3176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:58.478573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246bc14-46c6-4805-b9c6-8c1ed9df3176 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:58.478854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246bc14-46c6-4805-b9c6-8c1ed9df3176 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:58.479129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246bc14-46c6-4805-b9c6-8c1ed9df3176 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:58.479709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246bc14-46c6-4805-b9c6-8c1ed9df3176 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:58.481124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246bc14-46c6-4805-b9c6-8c1ed9df3176 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-9246bc14-46c6-4805-b9c6-8c1ed9df3176 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:02:58.490609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:02:58.491795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:02:58.493049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 481/967] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Oct 24 13:02:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 13:02:58.500136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3726c3-2e7c-4156-bb72-f20431055b0b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:58.617373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:58.628868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3726c3-2e7c-4156-bb72-f20431055b0b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:58.671104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cca35-fe6c-4914-80cf-db851e71cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:58.672010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cca35-fe6c-4914-80cf-db851e71cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:58.672405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cca35-fe6c-4914-80cf-db851e71cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:58.672736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cca35-fe6c-4914-80cf-db851e71cdb4 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:58.673575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cca35-fe6c-4914-80cf-db851e71cdb4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:58.673877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cca35-fe6c-4914-80cf-db851e71cdb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:58.675246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cca35-fe6c-4914-80cf-db851e71cdb4 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:58.680705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 487/968] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Oct 24 13:02:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:02:58.687102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246bc14-46c6-4805-b9c6-8c1ed9df3176 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:02:58.801945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:02:58.811559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246bc14-46c6-4805-b9c6-8c1ed9df3176 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:02:58.855737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90b372-1714-418f-a04f-7a17d029972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:02:58.856356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b372-1714-418f-a04f-7a17d029972e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:02:58.856635 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b372-1714-418f-a04f-7a17d029972e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:02:58.856903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b372-1714-418f-a04f-7a17d029972e None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:02:58.857593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90b372-1714-418f-a04f-7a17d029972e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:02:58.857890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90b372-1714-418f-a04f-7a17d029972e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:02:58.859461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90b372-1714-418f-a04f-7a17d029972e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:02:58.864937 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 482/969] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Oct 24 13:02:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:00.971625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d0796-428c-438e-9f0d-56e44f330673 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:00.972256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d0796-428c-438e-9f0d-56e44f330673 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:00.972256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d0796-428c-438e-9f0d-56e44f330673 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:00.973558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 488/970] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:00.979862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c24de4-307b-4381-bc9a-a3619d4959f7 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:00.980663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c24de4-307b-4381-bc9a-a3619d4959f7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:00.980821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c24de4-307b-4381-bc9a-a3619d4959f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:01.003818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-22c24de4-307b-4381-bc9a-a3619d4959f7 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:01.005062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-22c24de4-307b-4381-bc9a-a3619d4959f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:01.079976 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 483/971] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:03:01.345174 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d0796-428c-438e-9f0d-56e44f330673 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:01.454324 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d0796-428c-438e-9f0d-56e44f330673 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:01.490294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0da35e-54e0-46cf-b4e1-b7b860f7aa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:01.490889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0da35e-54e0-46cf-b4e1-b7b860f7aa15 None admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:01.491167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0da35e-54e0-46cf-b4e1-b7b860f7aa15 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:01.491439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0da35e-54e0-46cf-b4e1-b7b860f7aa15 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:01.492099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0da35e-54e0-46cf-b4e1-b7b860f7aa15 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:01.493506 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0da35e-54e0-46cf-b4e1-b7b860f7aa15 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:01.513628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 489/972] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Oct 24 13:03:01 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:03:03.660074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba01a2-07f1-4d0f-8a16-15787b8c15ad None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:03.660681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba01a2-07f1-4d0f-8a16-15787b8c15ad None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:03.660681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba01a2-07f1-4d0f-8a16-15787b8c15ad None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:03.662729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 484/973] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:03.671631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af7e0e-2e78-440c-95eb-eec85dcf491a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:03.672041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af7e0e-2e78-440c-95eb-eec85dcf491a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:03.672211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af7e0e-2e78-440c-95eb-eec85dcf491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:03.696925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-72af7e0e-2e78-440c-95eb-eec85dcf491a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:03.698129 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-72af7e0e-2e78-440c-95eb-eec85dcf491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:03.707392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:03.777944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 490/974] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:03:04.043646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba01a2-07f1-4d0f-8a16-15787b8c15ad None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:04.156319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:04.168153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba01a2-07f1-4d0f-8a16-15787b8c15ad None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:04.202946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ed604-998e-42bf-b509-7950da395885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:04.203563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed604-998e-42bf-b509-7950da395885 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:04.203922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed604-998e-42bf-b509-7950da395885 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:04.204195 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed604-998e-42bf-b509-7950da395885 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:04.204846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ed604-998e-42bf-b509-7950da395885 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:04.206241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ed604-998e-42bf-b509-7950da395885 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-f16ed604-998e-42bf-b509-7950da395885 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:04.215545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:04.220594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:03:04.221597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 485/975] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Oct 24 13:03:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:04.222886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af7e0e-2e78-440c-95eb-eec85dcf491a None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:04.328150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af7e0e-2e78-440c-95eb-eec85dcf491a None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:04.364744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048bf2c-9ac0-46a9-880e-ac70ac3de747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:04.365347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048bf2c-9ac0-46a9-880e-ac70ac3de747 None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:04.365621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048bf2c-9ac0-46a9-880e-ac70ac3de747 None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:04.365891 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048bf2c-9ac0-46a9-880e-ac70ac3de747 None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:04.366516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048bf2c-9ac0-46a9-880e-ac70ac3de747 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:04.366815 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048bf2c-9ac0-46a9-880e-ac70ac3de747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:04.368201 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048bf2c-9ac0-46a9-880e-ac70ac3de747 None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:04.373955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 491/976] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Oct 24 13:03:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:04.380321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ed604-998e-42bf-b509-7950da395885 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:04.491391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ed604-998e-42bf-b509-7950da395885 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:04.528932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6970e-a66c-445e-a44b-8b66f00e1bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:04.529567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6970e-a66c-445e-a44b-8b66f00e1bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:04.529875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6970e-a66c-445e-a44b-8b66f00e1bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:04.530280 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6970e-a66c-445e-a44b-8b66f00e1bc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:04.530940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6970e-a66c-445e-a44b-8b66f00e1bc5 None admin] RBAC: Adding query filter params (interface=public, service_id=bde6d895fb3b468e885a36e0c37a9ea4, region_id=RegionOne) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:04.531319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6970e-a66c-445e-a44b-8b66f00e1bc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:04.533187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6970e-a66c-445e-a44b-8b66f00e1bc5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:04.540646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 486/977] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Oct 24 13:03:04 2022] GET /identity/v3/endpoints?service_id=bde6d895fb3b468e885a36e0c37a9ea4&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:04.547193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048bf2c-9ac0-46a9-880e-ac70ac3de747 None admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:04.552787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:04.655526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048bf2c-9ac0-46a9-880e-ac70ac3de747 None admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:04.689419 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa9918-6c07-4f1c-a3c4-77a5f466c90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:04.690020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa9918-6c07-4f1c-a3c4-77a5f466c90f None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:04.690277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa9918-6c07-4f1c-a3c4-77a5f466c90f None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:04.690551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa9918-6c07-4f1c-a3c4-77a5f466c90f None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:04.691149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa9918-6c07-4f1c-a3c4-77a5f466c90f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:04.692559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa9918-6c07-4f1c-a3c4-77a5f466c90f None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:04.699395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 492/978] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Oct 24 13:03:04 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:03:06.818798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ae120-b5ca-455e-8625-764a2ca7168e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:06.819399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ae120-b5ca-455e-8625-764a2ca7168e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:06.819399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ae120-b5ca-455e-8625-764a2ca7168e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:06.820745 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 487/979] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:03:06.826978 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018b1a-c292-40cc-b7c2-a953dc79a2be None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:06.827731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018b1a-c292-40cc-b7c2-a953dc79a2be None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:06.827876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018b1a-c292-40cc-b7c2-a953dc79a2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:06.852780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-da018b1a-c292-40cc-b7c2-a953dc79a2be None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:03:06.853993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-da018b1a-c292-40cc-b7c2-a953dc79a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:03:06.918585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:06.925198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 493/980] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:03:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 13:03:07.191700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ae120-b5ca-455e-8625-764a2ca7168e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:07.214313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:07.300633 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ae120-b5ca-455e-8625-764a2ca7168e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:07.335641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb4608-9ba2-48a5-9973-e6279cfa0d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:07.336261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4608-9ba2-48a5-9973-e6279cfa0d28 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:07.336572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4608-9ba2-48a5-9973-e6279cfa0d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:07.336839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4608-9ba2-48a5-9973-e6279cfa0d28 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:07.337414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb4608-9ba2-48a5-9973-e6279cfa0d28 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:07.338782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb4608-9ba2-48a5-9973-e6279cfa0d28 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-18eb4608-9ba2-48a5-9973-e6279cfa0d28 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 13:03:07.347882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 13:03:07.349002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: ERROR keystone.server.flask.application Oct 24 13:03:07.349957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 488/981] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Oct 24 13:03:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 13:03:07.355875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da018b1a-c292-40cc-b7c2-a953dc79a2be None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:07.470913 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da018b1a-c292-40cc-b7c2-a953dc79a2be None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:07.506171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb43b47-4667-44fb-bec8-cdc3fee14d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:07.506795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb43b47-4667-44fb-bec8-cdc3fee14d7b None admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:07.507110 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb43b47-4667-44fb-bec8-cdc3fee14d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:07.507408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb43b47-4667-44fb-bec8-cdc3fee14d7b None admin] PATH_INFO: `/v3/services` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:07.508087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb43b47-4667-44fb-bec8-cdc3fee14d7b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:03:07.508490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb43b47-4667-44fb-bec8-cdc3fee14d7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:07.510055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb43b47-4667-44fb-bec8-cdc3fee14d7b None admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:07.515723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 494/982] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Oct 24 13:03:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:03:07.522019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb4608-9ba2-48a5-9973-e6279cfa0d28 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:03:07.617161 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:07.639338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb4608-9ba2-48a5-9973-e6279cfa0d28 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:03:07.675074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd15e2-da24-43c0-896e-ff334a3d2db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:03:07.675680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd15e2-da24-43c0-896e-ff334a3d2db4 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:03:07.675954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd15e2-da24-43c0-896e-ff334a3d2db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:03:07.676223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd15e2-da24-43c0-896e-ff334a3d2db4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:03:07.676920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd15e2-da24-43c0-896e-ff334a3d2db4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:03:07.678297 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd15e2-da24-43c0-896e-ff334a3d2db4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:03:07.701087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 489/983] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:03:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:03:17.512460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=69 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:03:17.696937 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:11.235295 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933733b1-0bdd-4adf-9286-fb76caefb079 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:11.236447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933733b1-0bdd-4adf-9286-fb76caefb079 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:11.236967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933733b1-0bdd-4adf-9286-fb76caefb079 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:11.244129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4360-0ae3-4858-b3db-3791afc14673 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:11.244984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4360-0ae3-4858-b3db-3791afc14673 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:11.245479 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4360-0ae3-4858-b3db-3791afc14673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:11.248623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 495/984] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:11 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:11.387116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f51a4360-0ae3-4858-b3db-3791afc14673 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:11.389714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f51a4360-0ae3-4858-b3db-3791afc14673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:11.539088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 490/985] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:04:11.833093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d4f28-2eb0-4be1-94a9-e759227053e6 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:11.833385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d4f28-2eb0-4be1-94a9-e759227053e6 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:11.833941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d4f28-2eb0-4be1-94a9-e759227053e6 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:11.835298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 496/986] 10.222.0.15 () {54 vars in 964 bytes} [Mon Oct 24 13:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:11.841701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44daeb7-bf0c-4d29-bb60-cd44fd8af287 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:11.842247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44daeb7-bf0c-4d29-bb60-cd44fd8af287 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:11.842745 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44daeb7-bf0c-4d29-bb60-cd44fd8af287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:11.925995 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a44daeb7-bf0c-4d29-bb60-cd44fd8af287 None None] MFA Rules not processed for user `974f2acdadf14df69cbe33351ee02a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:11.927323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a44daeb7-bf0c-4d29-bb60-cd44fd8af287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:11.949017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:12.008391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 491/987] 10.222.0.15 () {58 vars in 1061 bytes} [Mon Oct 24 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:12.018202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d4f28-2eb0-4be1-94a9-e759227053e6 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:12.020727 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-fe3d4f28-2eb0-4be1-94a9-e759227053e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:12.150536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d4f28-2eb0-4be1-94a9-e759227053e6 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:12.239477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f03856-0dbe-4dca-b9d7-35dbb4031bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:12.240922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f03856-0dbe-4dca-b9d7-35dbb4031bfd service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:12.241376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f03856-0dbe-4dca-b9d7-35dbb4031bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:12.241837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f03856-0dbe-4dca-b9d7-35dbb4031bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:12.244095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f7f03856-0dbe-4dca-b9d7-35dbb4031bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:12.304084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:12.363366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f03856-0dbe-4dca-b9d7-35dbb4031bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:12.364969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f03856-0dbe-4dca-b9d7-35dbb4031bfd service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:12.389005 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 497/988] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:14.805716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053cbb9-b153-463b-83ff-9113acd6c63e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:14.806190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053cbb9-b153-463b-83ff-9113acd6c63e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:14.806401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053cbb9-b153-463b-83ff-9113acd6c63e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:14.807628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 492/989] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:14.813183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60ea1-5e7b-4f0a-addc-18ec4d071f47 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:14.813581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60ea1-5e7b-4f0a-addc-18ec4d071f47 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:14.813729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60ea1-5e7b-4f0a-addc-18ec4d071f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:14.901259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-7be60ea1-5e7b-4f0a-addc-18ec4d071f47 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:14.903363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7be60ea1-5e7b-4f0a-addc-18ec4d071f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:15.006108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 498/990] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:15.308105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781786-38c1-4d5f-9c5e-d1055e4a1561 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:15.308416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781786-38c1-4d5f-9c5e-d1055e4a1561 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:15.308694 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781786-38c1-4d5f-9c5e-d1055e4a1561 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:15.310066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 493/991] 10.222.0.15 () {54 vars in 964 bytes} [Mon Oct 24 13:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:15.316744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9ed24-ead9-410b-a857-33c59002a552 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:15.317113 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9ed24-ead9-410b-a857-33c59002a552 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:15.317493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9ed24-ead9-410b-a857-33c59002a552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:15.336605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:15.403643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9ca9ed24-ead9-410b-a857-33c59002a552 None None] MFA Rules not processed for user `974f2acdadf14df69cbe33351ee02a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:15.404897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9ca9ed24-ead9-410b-a857-33c59002a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:15.483540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 499/992] 10.222.0.15 () {58 vars in 1061 bytes} [Mon Oct 24 13:04:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:15.492924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5781786-38c1-4d5f-9c5e-d1055e4a1561 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:15.494540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e5781786-38c1-4d5f-9c5e-d1055e4a1561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:15.601186 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5781786-38c1-4d5f-9c5e-d1055e4a1561 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:15.674072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:15.676739 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51280a-2305-41ea-a73e-8a6992555a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:15.677396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51280a-2305-41ea-a73e-8a6992555a4c service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:15.677682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51280a-2305-41ea-a73e-8a6992555a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:15.677958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51280a-2305-41ea-a73e-8a6992555a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:15.680404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8e51280a-2305-41ea-a73e-8a6992555a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:15.793729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51280a-2305-41ea-a73e-8a6992555a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:15.795209 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51280a-2305-41ea-a73e-8a6992555a4c service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:15.813797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 494/993] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:18.495133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eee5eb-d145-4b4a-80d4-07d9ace2449b None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:18.496012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eee5eb-d145-4b4a-80d4-07d9ace2449b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:18.496012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eee5eb-d145-4b4a-80d4-07d9ace2449b None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:18.498259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 500/994] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:18.503751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596d18-442d-4fe9-9eef-2109a4afc764 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:18.504175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596d18-442d-4fe9-9eef-2109a4afc764 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:18.504396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596d18-442d-4fe9-9eef-2109a4afc764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:18.572045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-17596d18-442d-4fe9-9eef-2109a4afc764 None None] MFA Rules not processed for user `333639fe14644e7fb57fd1eb110c2ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:18.573303 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-17596d18-442d-4fe9-9eef-2109a4afc764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:18.625915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:18.671738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 495/995] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:18.956821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eee5eb-d145-4b4a-80d4-07d9ace2449b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:18.959315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-54eee5eb-d145-4b4a-80d4-07d9ace2449b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:19.072130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eee5eb-d145-4b4a-80d4-07d9ace2449b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:19.075052 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:19.149697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df4743-0377-4e47-b808-da97a437bdba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:19.150322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df4743-0377-4e47-b808-da97a437bdba service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:19.150603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df4743-0377-4e47-b808-da97a437bdba service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:19.150871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df4743-0377-4e47-b808-da97a437bdba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:19.152759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f8df4743-0377-4e47-b808-da97a437bdba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:19.267696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df4743-0377-4e47-b808-da97a437bdba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:19.269165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df4743-0377-4e47-b808-da97a437bdba service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:19.288576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 501/996] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:21.967059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c0fe-beab-4645-9f8f-5a3116d1d1d4 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:21.967965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c0fe-beab-4645-9f8f-5a3116d1d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:21.967965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c0fe-beab-4645-9f8f-5a3116d1d1d4 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:21.970117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 496/997] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:21.976631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380b867-33b8-4cbc-a187-23a62350ad13 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:21.977325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380b867-33b8-4cbc-a187-23a62350ad13 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:21.977480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380b867-33b8-4cbc-a187-23a62350ad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:22.027109 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:22.053918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-e380b867-33b8-4cbc-a187-23a62350ad13 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:22.055131 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e380b867-33b8-4cbc-a187-23a62350ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:22.155099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 502/998] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:22.439187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c0fe-beab-4645-9f8f-5a3116d1d1d4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:22.440776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ce99c0fe-beab-4645-9f8f-5a3116d1d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:22.550935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c0fe-beab-4645-9f8f-5a3116d1d1d4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:22.627961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4e73f-9684-4d90-b41c-7befb638ad38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:22.628604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4e73f-9684-4d90-b41c-7befb638ad38 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:22.628874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4e73f-9684-4d90-b41c-7befb638ad38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:22.629152 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4e73f-9684-4d90-b41c-7befb638ad38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:22.630728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a6e4e73f-9684-4d90-b41c-7befb638ad38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:22.637622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:22.744051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4e73f-9684-4d90-b41c-7befb638ad38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:22.745443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4e73f-9684-4d90-b41c-7befb638ad38 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:22.765340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 497/999] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:25.511457 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a540de-9542-4cd7-a9c9-5b0057d0654c None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:25.512179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a540de-9542-4cd7-a9c9-5b0057d0654c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:25.512179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a540de-9542-4cd7-a9c9-5b0057d0654c None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:25.513680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 503/1000] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:25.519668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d02e48-74e1-4ed0-a12f-e1f495da80c1 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:25.520105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d02e48-74e1-4ed0-a12f-e1f495da80c1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:25.520242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d02e48-74e1-4ed0-a12f-e1f495da80c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:25.590826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-36d02e48-74e1-4ed0-a12f-e1f495da80c1 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:25.592078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-36d02e48-74e1-4ed0-a12f-e1f495da80c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:25.656890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:25.697393 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 498/1001] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:25.972601 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a540de-9542-4cd7-a9c9-5b0057d0654c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:25.975082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-01a540de-9542-4cd7-a9c9-5b0057d0654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:26.083998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a540de-9542-4cd7-a9c9-5b0057d0654c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:26.097084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:26.159717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05dcdb-6da7-408b-8f7a-9ec5bffc260f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:26.160348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05dcdb-6da7-408b-8f7a-9ec5bffc260f service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:26.160626 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05dcdb-6da7-408b-8f7a-9ec5bffc260f service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:26.160895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05dcdb-6da7-408b-8f7a-9ec5bffc260f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:26.162482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cf05dcdb-6da7-408b-8f7a-9ec5bffc260f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:26.273753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05dcdb-6da7-408b-8f7a-9ec5bffc260f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:26.275195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05dcdb-6da7-408b-8f7a-9ec5bffc260f service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:26.293931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 504/1002] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:28.458784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9d2ce-65ea-48fa-a36a-52390bdba32c None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:28.459330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9d2ce-65ea-48fa-a36a-52390bdba32c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:28.459330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9d2ce-65ea-48fa-a36a-52390bdba32c None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:28.460720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 499/1003] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:28.466306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4c6fd-b414-45e0-97cf-3079cf7f1599 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:28.466782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4c6fd-b414-45e0-97cf-3079cf7f1599 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:28.466914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4c6fd-b414-45e0-97cf-3079cf7f1599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:28.518866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:28.538190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4ef4c6fd-b414-45e0-97cf-3079cf7f1599 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:28.539404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4ef4c6fd-b414-45e0-97cf-3079cf7f1599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:28.648389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 505/1004] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:28.926142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9d2ce-65ea-48fa-a36a-52390bdba32c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:28.927758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-07d9d2ce-65ea-48fa-a36a-52390bdba32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:29.033016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9d2ce-65ea-48fa-a36a-52390bdba32c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:29.106410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcae3f-2823-49fb-a8bc-8918fecb9a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:29.107008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcae3f-2823-49fb-a8bc-8918fecb9a82 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:29.107280 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcae3f-2823-49fb-a8bc-8918fecb9a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:29.107545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcae3f-2823-49fb-a8bc-8918fecb9a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:29.109144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-53fcae3f-2823-49fb-a8bc-8918fecb9a82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:29.126744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:29.223236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcae3f-2823-49fb-a8bc-8918fecb9a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:29.224601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcae3f-2823-49fb-a8bc-8918fecb9a82 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:29.243505 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 500/1005] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:31.415073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06539c-fd26-482a-a724-51eaeb56afa8 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:31.415587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06539c-fd26-482a-a724-51eaeb56afa8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:31.415587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06539c-fd26-482a-a724-51eaeb56afa8 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:31.416939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 506/1006] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:31.422582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d61947-9593-45d5-868c-18bb06d4e1fb None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:31.422999 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d61947-9593-45d5-868c-18bb06d4e1fb None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:31.423125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d61947-9593-45d5-868c-18bb06d4e1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:31.490438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-18d61947-9593-45d5-868c-18bb06d4e1fb None None] MFA Rules not processed for user `333639fe14644e7fb57fd1eb110c2ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:31.491651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-18d61947-9593-45d5-868c-18bb06d4e1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:31.558823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:31.590485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 501/1007] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:31.867973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06539c-fd26-482a-a724-51eaeb56afa8 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:31.869554 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3a06539c-fd26-482a-a724-51eaeb56afa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:31.982389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06539c-fd26-482a-a724-51eaeb56afa8 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:32.003461 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:32.058030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0d50e-4b41-4ba7-880f-c956e24ee79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:32.058612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0d50e-4b41-4ba7-880f-c956e24ee79c service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:32.058885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0d50e-4b41-4ba7-880f-c956e24ee79c service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:32.059177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0d50e-4b41-4ba7-880f-c956e24ee79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:32.060855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9da0d50e-4b41-4ba7-880f-c956e24ee79c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:32.175989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0d50e-4b41-4ba7-880f-c956e24ee79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:32.177501 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0d50e-4b41-4ba7-880f-c956e24ee79c service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:32.195884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 507/1008] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:34.521012 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d02a13-257c-4ac5-82a2-cf650479ffda None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:34.521638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d02a13-257c-4ac5-82a2-cf650479ffda None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:34.521638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d02a13-257c-4ac5-82a2-cf650479ffda None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:34.522944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 502/1009] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:34.529160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133a249-bac6-4eb8-8c8f-c4f2a875bbae None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:34.529621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133a249-bac6-4eb8-8c8f-c4f2a875bbae None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:34.529726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133a249-bac6-4eb8-8c8f-c4f2a875bbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:34.601889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:34.604838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4133a249-bac6-4eb8-8c8f-c4f2a875bbae None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:34.606597 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4133a249-bac6-4eb8-8c8f-c4f2a875bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:34.705379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 508/1010] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:34.982734 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d02a13-257c-4ac5-82a2-cf650479ffda None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:34.984260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b6d02a13-257c-4ac5-82a2-cf650479ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:35.095100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d02a13-257c-4ac5-82a2-cf650479ffda None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:35.171007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e95de-d39d-4011-a100-5a4856de3a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:35.171662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e95de-d39d-4011-a100-5a4856de3a4d service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:35.171941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e95de-d39d-4011-a100-5a4856de3a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:35.172214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e95de-d39d-4011-a100-5a4856de3a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:35.173927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-751e95de-d39d-4011-a100-5a4856de3a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:35.201295 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:35.285406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e95de-d39d-4011-a100-5a4856de3a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:35.286876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e95de-d39d-4011-a100-5a4856de3a4d service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:35.306540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 503/1011] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:37.491975 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16b2e7-19cf-4b92-9420-69d293f8d1ad None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:37.492922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16b2e7-19cf-4b92-9420-69d293f8d1ad None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:37.492922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16b2e7-19cf-4b92-9420-69d293f8d1ad None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:37.495184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 509/1012] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:37.501656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9810-af12-4d58-b2c2-f8c563f9b72a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:37.502312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9810-af12-4d58-b2c2-f8c563f9b72a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:37.502429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9810-af12-4d58-b2c2-f8c563f9b72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:37.573191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-41ea9810-af12-4d58-b2c2-f8c563f9b72a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:37.574498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-41ea9810-af12-4d58-b2c2-f8c563f9b72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:37.653750 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:37.676796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 504/1013] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:37.961381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16b2e7-19cf-4b92-9420-69d293f8d1ad None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:37.963873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9f16b2e7-19cf-4b92-9420-69d293f8d1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:38.078009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16b2e7-19cf-4b92-9420-69d293f8d1ad None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:38.106527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:38.155138 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a569c7-20ca-4831-a6a3-9447b76883db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:38.155749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a569c7-20ca-4831-a6a3-9447b76883db service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:38.156029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a569c7-20ca-4831-a6a3-9447b76883db service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:38.156325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a569c7-20ca-4831-a6a3-9447b76883db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:38.157933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-33a569c7-20ca-4831-a6a3-9447b76883db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:38.268797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a569c7-20ca-4831-a6a3-9447b76883db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:38.270241 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a569c7-20ca-4831-a6a3-9447b76883db service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:38.288400 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 510/1014] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:41.014874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8692b-2b48-4dfb-8c9a-e7ecbd998200 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:41.015732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8692b-2b48-4dfb-8c9a-e7ecbd998200 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:41.015732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8692b-2b48-4dfb-8c9a-e7ecbd998200 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:41.018062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 505/1015] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:41.023491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7748d-31af-4f61-9d9a-e30e7de3db1c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:41.023942 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7748d-31af-4f61-9d9a-e30e7de3db1c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:41.024049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7748d-31af-4f61-9d9a-e30e7de3db1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:41.092272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a3c7748d-31af-4f61-9d9a-e30e7de3db1c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:41.093408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a3c7748d-31af-4f61-9d9a-e30e7de3db1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:41.101618 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:41.190897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 511/1016] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:41.468060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8692b-2b48-4dfb-8c9a-e7ecbd998200 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:41.470435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-97c8692b-2b48-4dfb-8c9a-e7ecbd998200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:41.586101 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8692b-2b48-4dfb-8c9a-e7ecbd998200 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:41.660062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9e903-d180-4c6f-b528-54ed7cb981a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:41.660723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9e903-d180-4c6f-b528-54ed7cb981a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:41.661007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9e903-d180-4c6f-b528-54ed7cb981a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:41.661251 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9e903-d180-4c6f-b528-54ed7cb981a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:41.662826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-95b9e903-d180-4c6f-b528-54ed7cb981a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:41.699085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:41.789786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9e903-d180-4c6f-b528-54ed7cb981a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:41.791725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9e903-d180-4c6f-b528-54ed7cb981a7 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:41.811500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 506/1017] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:46.027293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4e39-3d0d-4cb5-b7b9-b98501618111 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:46.027816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4e39-3d0d-4cb5-b7b9-b98501618111 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:46.027816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4e39-3d0d-4cb5-b7b9-b98501618111 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:46.029156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 512/1018] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:46.034549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a86f4-dfd7-4485-8b43-6fb7e0fa1dc3 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:46.034984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a86f4-dfd7-4485-8b43-6fb7e0fa1dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:46.035223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a86f4-dfd7-4485-8b43-6fb7e0fa1dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:46.104513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1a7a86f4-dfd7-4485-8b43-6fb7e0fa1dc3 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:46.105721 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1a7a86f4-dfd7-4485-8b43-6fb7e0fa1dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:46.196450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:46.207791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 507/1019] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:46.485037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd4e39-3d0d-4cb5-b7b9-b98501618111 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:46.486589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5dbd4e39-3d0d-4cb5-b7b9-b98501618111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:46.593266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd4e39-3d0d-4cb5-b7b9-b98501618111 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:46.634076 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:46.672067 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa9caf-a144-43f9-bfed-8bffa5ef32a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:46.672686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa9caf-a144-43f9-bfed-8bffa5ef32a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:46.672964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa9caf-a144-43f9-bfed-8bffa5ef32a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:46.673234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa9caf-a144-43f9-bfed-8bffa5ef32a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:46.674850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c2fa9caf-a144-43f9-bfed-8bffa5ef32a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:46.785685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa9caf-a144-43f9-bfed-8bffa5ef32a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:46.787020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa9caf-a144-43f9-bfed-8bffa5ef32a9 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:46.805401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 513/1020] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:49.543763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75d70a-016d-4b53-8863-d28134ca474f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:49.544397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75d70a-016d-4b53-8863-d28134ca474f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:49.544397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75d70a-016d-4b53-8863-d28134ca474f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:49.545894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 508/1021] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:49.550975 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649929-8731-434f-8360-5c2dd276dc2a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:49.551395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649929-8731-434f-8360-5c2dd276dc2a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:49.551503 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649929-8731-434f-8360-5c2dd276dc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:49.619203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d2649929-8731-434f-8360-5c2dd276dc2a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:49.620646 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d2649929-8731-434f-8360-5c2dd276dc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:49.640045 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:49.726473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 514/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:50.004423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75d70a-016d-4b53-8863-d28134ca474f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:50.005929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3f75d70a-016d-4b53-8863-d28134ca474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:50.118006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75d70a-016d-4b53-8863-d28134ca474f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:50.194069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6da8b4-a895-48ff-a30b-a3a1808d3ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:50.194694 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6da8b4-a895-48ff-a30b-a3a1808d3ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:50.194975 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6da8b4-a895-48ff-a30b-a3a1808d3ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:50.195248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6da8b4-a895-48ff-a30b-a3a1808d3ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:50.196870 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3c6da8b4-a895-48ff-a30b-a3a1808d3ac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:50.242321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:50.310558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6da8b4-a895-48ff-a30b-a3a1808d3ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:50.311997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6da8b4-a895-48ff-a30b-a3a1808d3ac6 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:50.330449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 509/1023] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:04:54.404248 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ff8e9-c360-48b0-9b34-7262955a9b27 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:54.404779 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ff8e9-c360-48b0-9b34-7262955a9b27 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:54.404869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ff8e9-c360-48b0-9b34-7262955a9b27 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:54.406350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 515/1024] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:04:54.412366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eb194-11fd-45ea-9f0b-6bb3f03cdf46 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:54.412946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eb194-11fd-45ea-9f0b-6bb3f03cdf46 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:54.413089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eb194-11fd-45ea-9f0b-6bb3f03cdf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:54.492746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1a7eb194-11fd-45ea-9f0b-6bb3f03cdf46 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:04:54.493985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1a7eb194-11fd-45ea-9f0b-6bb3f03cdf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:54.590494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:54.592842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 510/1025] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:04:54.871011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ff8e9-c360-48b0-9b34-7262955a9b27 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:04:54.872581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-646ff8e9-c360-48b0-9b34-7262955a9b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:54.977653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ff8e9-c360-48b0-9b34-7262955a9b27 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:04:55.028449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:04:55.055196 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bf2cf-af37-4ef7-8468-74931c4447f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:04:55.055811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf2cf-af37-4ef7-8468-74931c4447f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:04:55.056116 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf2cf-af37-4ef7-8468-74931c4447f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:04:55.056425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf2cf-af37-4ef7-8468-74931c4447f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:04:55.058101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-718bf2cf-af37-4ef7-8468-74931c4447f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:04:55.174302 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bf2cf-af37-4ef7-8468-74931c4447f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:04:55.175777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bf2cf-af37-4ef7-8468-74931c4447f6 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:04:55.195665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 516/1026] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:00.090690 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64685f70-3493-494e-8be6-b0251bbcde14 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:00.091136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64685f70-3493-494e-8be6-b0251bbcde14 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:00.091355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64685f70-3493-494e-8be6-b0251bbcde14 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:00.093268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 511/1027] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:00.098530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dd7b5-83ec-459a-a7eb-2792d1369b65 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:00.098949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dd7b5-83ec-459a-a7eb-2792d1369b65 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:00.099028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dd7b5-83ec-459a-a7eb-2792d1369b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:00.271364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c34dd7b5-83ec-459a-a7eb-2792d1369b65 None None] MFA Rules not processed for user `3a25b60f83d84fb38a759d6620c1c58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:00.272614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c34dd7b5-83ec-459a-a7eb-2792d1369b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:00.296354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:00.397452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 517/1028] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:05:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:05:04.405314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f02758-fa7c-42d8-8e41-5e5a94218032 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:04.406274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f02758-fa7c-42d8-8e41-5e5a94218032 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:04.406776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f02758-fa7c-42d8-8e41-5e5a94218032 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:04.408319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 512/1029] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:04.413949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eeeb9-3397-4bc5-9ee5-00d4aa1bac93 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:04.414420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eeeb9-3397-4bc5-9ee5-00d4aa1bac93 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:04.414509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eeeb9-3397-4bc5-9ee5-00d4aa1bac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:04.497505 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-193eeeb9-3397-4bc5-9ee5-00d4aa1bac93 None None] MFA Rules not processed for user `3a25b60f83d84fb38a759d6620c1c58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:04.498743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-193eeeb9-3397-4bc5-9ee5-00d4aa1bac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:04.575012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:04.614878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 518/1030] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:05:05.968843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523fc5e-a190-4fcf-9474-9745f376c7d5 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:05.969419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523fc5e-a190-4fcf-9474-9745f376c7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:05.969636 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523fc5e-a190-4fcf-9474-9745f376c7d5 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:05.971208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 513/1031] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:05.976777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769df6f-fa4d-400a-bccc-a8088fd35e36 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:05.977258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769df6f-fa4d-400a-bccc-a8088fd35e36 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:05.977352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769df6f-fa4d-400a-bccc-a8088fd35e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:06.056043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-6769df6f-fa4d-400a-bccc-a8088fd35e36 None None] MFA Rules not processed for user `3a25b60f83d84fb38a759d6620c1c58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:06.057324 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6769df6f-fa4d-400a-bccc-a8088fd35e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:06.163909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 519/1032] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:05:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:09.686262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ae21-2999-4852-8790-c388eaed20a4 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:09.686834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ae21-2999-4852-8790-c388eaed20a4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:09.686834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ae21-2999-4852-8790-c388eaed20a4 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:09.688128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 514/1033] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:09.693660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce9dde-70d5-4a3b-9039-06fd95017633 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:09.694056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce9dde-70d5-4a3b-9039-06fd95017633 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:09.694227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce9dde-70d5-4a3b-9039-06fd95017633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:09.734683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:09.768755 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-afce9dde-70d5-4a3b-9039-06fd95017633 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:09.770341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-afce9dde-70d5-4a3b-9039-06fd95017633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:09.874341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 520/1034] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:10.173549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d35c62-51d0-4b29-b3c3-6e111eee4a6f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:10.173947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d35c62-51d0-4b29-b3c3-6e111eee4a6f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:10.174314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d35c62-51d0-4b29-b3c3-6e111eee4a6f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:10.175926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 515/1035] 10.222.0.15 () {54 vars in 961 bytes} [Mon Oct 24 13:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:10.185453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843033a-fa6a-46c6-b3c9-e95b02a6a386 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:10.186346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843033a-fa6a-46c6-b3c9-e95b02a6a386 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:10.187537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843033a-fa6a-46c6-b3c9-e95b02a6a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:10.269082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8843033a-fa6a-46c6-b3c9-e95b02a6a386 None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:10.270386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8843033a-fa6a-46c6-b3c9-e95b02a6a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:10.318928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:10.391982 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 521/1036] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Oct 24 13:05:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:05:10.401413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d35c62-51d0-4b29-b3c3-6e111eee4a6f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:10.402845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-94d35c62-51d0-4b29-b3c3-6e111eee4a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:10.565365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d35c62-51d0-4b29-b3c3-6e111eee4a6f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:10.643901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:10.685977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d52012-cf7b-477e-863e-bc6ca20a848a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:10.686508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d52012-cf7b-477e-863e-bc6ca20a848a service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:10.687089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d52012-cf7b-477e-863e-bc6ca20a848a service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:10.687089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d52012-cf7b-477e-863e-bc6ca20a848a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:10.688629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f3d52012-cf7b-477e-863e-bc6ca20a848a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:10.793585 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d52012-cf7b-477e-863e-bc6ca20a848a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:10.795231 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d52012-cf7b-477e-863e-bc6ca20a848a service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:10.814844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 516/1037] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:13.187774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fd5d7-c8ca-4a23-8721-d2db1fcfdaa7 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:13.188330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fd5d7-c8ca-4a23-8721-d2db1fcfdaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:13.188330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fd5d7-c8ca-4a23-8721-d2db1fcfdaa7 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:13.190545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 522/1038] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:13.195985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead8d22-275e-489c-8473-449205aef59a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:13.195985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead8d22-275e-489c-8473-449205aef59a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:13.195985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead8d22-275e-489c-8473-449205aef59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:13.266124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7ead8d22-275e-489c-8473-449205aef59a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:13.267369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7ead8d22-275e-489c-8473-449205aef59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:13.309604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:13.368331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 517/1039] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:13.656828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fd5d7-c8ca-4a23-8721-d2db1fcfdaa7 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:13.658985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-282fd5d7-c8ca-4a23-8721-d2db1fcfdaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:13.836705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fd5d7-c8ca-4a23-8721-d2db1fcfdaa7 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:13.859717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:13.973778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8fe76-7597-414d-9bdf-c82580a2fbb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:13.974706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8fe76-7597-414d-9bdf-c82580a2fbb2 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:13.974706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8fe76-7597-414d-9bdf-c82580a2fbb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:13.974997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8fe76-7597-414d-9bdf-c82580a2fbb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:13.976566 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-30f8fe76-7597-414d-9bdf-c82580a2fbb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:14.067479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8fe76-7597-414d-9bdf-c82580a2fbb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:14.069302 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8fe76-7597-414d-9bdf-c82580a2fbb2 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:14.088234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 523/1040] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:16.554267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d266fd6-4eca-413d-ad1d-27e163139e19 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:16.555226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d266fd6-4eca-413d-ad1d-27e163139e19 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:16.555502 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d266fd6-4eca-413d-ad1d-27e163139e19 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:16.556990 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 518/1041] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:16.563484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ecb28-abea-4a0a-b288-a09ff1296074 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:16.563889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ecb28-abea-4a0a-b288-a09ff1296074 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:16.564049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ecb28-abea-4a0a-b288-a09ff1296074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:16.582552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:16.644332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a71ecb28-abea-4a0a-b288-a09ff1296074 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:16.645463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a71ecb28-abea-4a0a-b288-a09ff1296074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:16.760319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 524/1042] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:17.055285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dfb46-0989-49a1-a1db-910d19f3fc0c None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:17.055641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dfb46-0989-49a1-a1db-910d19f3fc0c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:17.056016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dfb46-0989-49a1-a1db-910d19f3fc0c None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:17.057630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 519/1043] 10.222.0.15 () {54 vars in 961 bytes} [Mon Oct 24 13:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:17.063578 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce6a6b-b665-496a-bb7d-f5e1db190d66 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:17.064033 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce6a6b-b665-496a-bb7d-f5e1db190d66 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:17.064551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce6a6b-b665-496a-bb7d-f5e1db190d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:17.143829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5dce6a6b-b665-496a-bb7d-f5e1db190d66 None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:17.145092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5dce6a6b-b665-496a-bb7d-f5e1db190d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:17.181694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:17.269533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 525/1044] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Oct 24 13:05:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:17.278656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dfb46-0989-49a1-a1db-910d19f3fc0c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:17.280162 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-db6dfb46-0989-49a1-a1db-910d19f3fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:17.433246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dfb46-0989-49a1-a1db-910d19f3fc0c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:17.454398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:17.552791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b450db1-55e8-43e9-b605-cc2c60f04a83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:17.553387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b450db1-55e8-43e9-b605-cc2c60f04a83 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:17.553694 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b450db1-55e8-43e9-b605-cc2c60f04a83 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:17.553945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b450db1-55e8-43e9-b605-cc2c60f04a83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:17.555556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9b450db1-55e8-43e9-b605-cc2c60f04a83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:17.652823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b450db1-55e8-43e9-b605-cc2c60f04a83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:17.654485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b450db1-55e8-43e9-b605-cc2c60f04a83 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:17.676479 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 520/1045] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:05:17.761397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4e4fc-312b-4706-9ed5-503744a91848 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:17.761928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4e4fc-312b-4706-9ed5-503744a91848 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:17.761928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4e4fc-312b-4706-9ed5-503744a91848 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:17.763432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 526/1046] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:17.769166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71d43a-f270-404f-bbcf-4e4543528328 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:17.769456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71d43a-f270-404f-bbcf-4e4543528328 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:17.769940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71d43a-f270-404f-bbcf-4e4543528328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:17.806151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:17.848434 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2f71d43a-f270-404f-bbcf-4e4543528328 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:17.849598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2f71d43a-f270-404f-bbcf-4e4543528328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:17.977403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 521/1047] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:18.306636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46195f12-abfe-4c6c-862b-508966379bc8 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:18.306842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46195f12-abfe-4c6c-862b-508966379bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:18.306998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46195f12-abfe-4c6c-862b-508966379bc8 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:18.308469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 527/1048] 10.222.0.15 () {54 vars in 963 bytes} [Mon Oct 24 13:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:18.313507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fcd5c-d844-4a66-bda2-e2a37c96e7a3 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:18.313796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fcd5c-d844-4a66-bda2-e2a37c96e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:18.314071 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fcd5c-d844-4a66-bda2-e2a37c96e7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:18.394350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-014fcd5c-d844-4a66-bda2-e2a37c96e7a3 None None] MFA Rules not processed for user `c9b6f4afedfc4d45995b8a671e2d01e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:18.395780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-014fcd5c-d844-4a66-bda2-e2a37c96e7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:18.445211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:18.476433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 522/1049] 10.222.0.15 () {58 vars in 1060 bytes} [Mon Oct 24 13:05:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:18.484008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46195f12-abfe-4c6c-862b-508966379bc8 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:18.485538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-46195f12-abfe-4c6c-862b-508966379bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:18.598541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46195f12-abfe-4c6c-862b-508966379bc8 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:18.643932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:18.686252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71dbb5-9e0e-4f1f-bd23-095cda550810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:18.686866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71dbb5-9e0e-4f1f-bd23-095cda550810 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:18.687169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71dbb5-9e0e-4f1f-bd23-095cda550810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:18.687542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71dbb5-9e0e-4f1f-bd23-095cda550810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:18.689477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9a71dbb5-9e0e-4f1f-bd23-095cda550810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:18.812956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71dbb5-9e0e-4f1f-bd23-095cda550810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:18.814387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71dbb5-9e0e-4f1f-bd23-095cda550810 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:18.834978 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 528/1050] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:19.895143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d471-a22a-428b-8fa0-c9b62275ce6f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:19.895723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d471-a22a-428b-8fa0-c9b62275ce6f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:19.895723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d471-a22a-428b-8fa0-c9b62275ce6f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:19.897159 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 523/1051] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:19.902832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20181-a8b4-40cb-9ed1-98a008ae89f2 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:19.903251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20181-a8b4-40cb-9ed1-98a008ae89f2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:19.903426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20181-a8b4-40cb-9ed1-98a008ae89f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:19.969008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-caf20181-a8b4-40cb-9ed1-98a008ae89f2 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:19.970207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-caf20181-a8b4-40cb-9ed1-98a008ae89f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:19.991337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:20.067885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 529/1052] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:20.356266 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5d471-a22a-428b-8fa0-c9b62275ce6f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:20.357989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a4f5d471-a22a-428b-8fa0-c9b62275ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:20.519023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5d471-a22a-428b-8fa0-c9b62275ce6f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:20.572708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:20.634614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8f840-5187-460d-82f5-ae7a18451623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:20.635231 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f840-5187-460d-82f5-ae7a18451623 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:20.635507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f840-5187-460d-82f5-ae7a18451623 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:20.635776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f840-5187-460d-82f5-ae7a18451623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:20.637408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0de8f840-5187-460d-82f5-ae7a18451623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:20.740778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8f840-5187-460d-82f5-ae7a18451623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:20.742307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8f840-5187-460d-82f5-ae7a18451623 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:20.760826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 524/1053] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:22.958834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e56171-a48e-40ee-ae61-28fec1c16612 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:22.959390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e56171-a48e-40ee-ae61-28fec1c16612 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:22.959390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e56171-a48e-40ee-ae61-28fec1c16612 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:22.960955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 530/1054] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:22.966182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85eda8-5801-466d-b5bb-d3fb94ee8123 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:22.966642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85eda8-5801-466d-b5bb-d3fb94ee8123 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:22.966724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85eda8-5801-466d-b5bb-d3fb94ee8123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:23.039455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ec85eda8-5801-466d-b5bb-d3fb94ee8123 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:23.040986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ec85eda8-5801-466d-b5bb-d3fb94ee8123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:23.048917 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:23.150584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 525/1055] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:23.435129 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e56171-a48e-40ee-ae61-28fec1c16612 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:23.436676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b3e56171-a48e-40ee-ae61-28fec1c16612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:23.587097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e56171-a48e-40ee-ae61-28fec1c16612 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:23.590758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:23.705962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd106f-b705-437f-a270-5c6cd422fb2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:23.706587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd106f-b705-437f-a270-5c6cd422fb2b service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:23.706937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd106f-b705-437f-a270-5c6cd422fb2b service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:23.707289 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd106f-b705-437f-a270-5c6cd422fb2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:23.709008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cddd106f-b705-437f-a270-5c6cd422fb2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:23.800154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd106f-b705-437f-a270-5c6cd422fb2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:23.801930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd106f-b705-437f-a270-5c6cd422fb2b service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:23.820578 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 531/1056] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:26.017363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d520f03-814f-4e14-803d-f910efa3bdad None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:26.017908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d520f03-814f-4e14-803d-f910efa3bdad None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:26.017908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d520f03-814f-4e14-803d-f910efa3bdad None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:26.019275 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 526/1057] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:26.024790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec692d5-fa98-4443-ae9a-64ce20ac90d2 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:26.025199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec692d5-fa98-4443-ae9a-64ce20ac90d2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:26.025276 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec692d5-fa98-4443-ae9a-64ce20ac90d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:26.037294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:26.095958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4ec692d5-fa98-4443-ae9a-64ce20ac90d2 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:26.097147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4ec692d5-fa98-4443-ae9a-64ce20ac90d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:26.217022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 532/1058] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:26.494997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d520f03-814f-4e14-803d-f910efa3bdad None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:26.496624 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5d520f03-814f-4e14-803d-f910efa3bdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:26.659351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:26.670811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d520f03-814f-4e14-803d-f910efa3bdad None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:26.805568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92411b0-a955-43e9-a06d-aa3a4c17acb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:26.806146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92411b0-a955-43e9-a06d-aa3a4c17acb6 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:26.806407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92411b0-a955-43e9-a06d-aa3a4c17acb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:26.806705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92411b0-a955-43e9-a06d-aa3a4c17acb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:26.808402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b92411b0-a955-43e9-a06d-aa3a4c17acb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:26.917594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92411b0-a955-43e9-a06d-aa3a4c17acb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:26.919830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92411b0-a955-43e9-a06d-aa3a4c17acb6 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:26.931743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:26.941674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 527/1059] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:29.181294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc9514-efff-43a6-9e32-bf568dc5e33d None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:29.181897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc9514-efff-43a6-9e32-bf568dc5e33d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:29.182041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc9514-efff-43a6-9e32-bf568dc5e33d None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:29.184038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 533/1060] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:29.190078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd0fa-35f1-4b5e-a6b8-2430163cd08f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:29.190527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd0fa-35f1-4b5e-a6b8-2430163cd08f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:29.190630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd0fa-35f1-4b5e-a6b8-2430163cd08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:29.260143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f7cbd0fa-35f1-4b5e-a6b8-2430163cd08f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:29.261759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f7cbd0fa-35f1-4b5e-a6b8-2430163cd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:29.369122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 528/1061] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:29.672858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc9514-efff-43a6-9e32-bf568dc5e33d None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:29.674637 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-14dc9514-efff-43a6-9e32-bf568dc5e33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:29.764001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:29.839157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc9514-efff-43a6-9e32-bf568dc5e33d None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:29.964390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0c5c8-b2c1-414a-9013-67817b89bbb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:29.965057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c5c8-b2c1-414a-9013-67817b89bbb2 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:29.965463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c5c8-b2c1-414a-9013-67817b89bbb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:29.965762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c5c8-b2c1-414a-9013-67817b89bbb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:29.967210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a2c0c5c8-b2c1-414a-9013-67817b89bbb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:30.019362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:30.065592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0c5c8-b2c1-414a-9013-67817b89bbb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:30.067907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0c5c8-b2c1-414a-9013-67817b89bbb2 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:30.093015 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 534/1062] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:32.290631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba11524-33c5-4beb-873e-9c09a9c2d19a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:32.291201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba11524-33c5-4beb-873e-9c09a9c2d19a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:32.291201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba11524-33c5-4beb-873e-9c09a9c2d19a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:32.292655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 529/1063] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:32.298055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe851c1-0361-47c8-92d0-599c53266c86 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:32.298505 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe851c1-0361-47c8-92d0-599c53266c86 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:32.298626 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe851c1-0361-47c8-92d0-599c53266c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:32.365956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-fbe851c1-0361-47c8-92d0-599c53266c86 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:32.367216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-fbe851c1-0361-47c8-92d0-599c53266c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:32.466164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 535/1064] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:32.753198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba11524-33c5-4beb-873e-9c09a9c2d19a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:32.754709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cba11524-33c5-4beb-873e-9c09a9c2d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:32.840066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:32.917947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba11524-33c5-4beb-873e-9c09a9c2d19a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:33.032948 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211ca89-590a-4a09-a3ed-3f8e920967d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:33.033475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ca89-590a-4a09-a3ed-3f8e920967d6 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:33.033750 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ca89-590a-4a09-a3ed-3f8e920967d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:33.034018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ca89-590a-4a09-a3ed-3f8e920967d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:33.035583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3211ca89-590a-4a09-a3ed-3f8e920967d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:33.074129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:33.128933 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211ca89-590a-4a09-a3ed-3f8e920967d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:33.130560 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211ca89-590a-4a09-a3ed-3f8e920967d6 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:33.149174 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 530/1065] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:34.053123 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6784-3bdb-44c8-8cb4-0cf3a339bfce None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:34.053748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6784-3bdb-44c8-8cb4-0cf3a339bfce None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:34.053748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6784-3bdb-44c8-8cb4-0cf3a339bfce None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:34.055198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 536/1066] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:34.060977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8d02-4037-45d7-b185-517c90b48807 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:34.061597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8d02-4037-45d7-b185-517c90b48807 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:34.061597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8d02-4037-45d7-b185-517c90b48807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:34.131416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-18ba8d02-4037-45d7-b185-517c90b48807 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:34.132599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-18ba8d02-4037-45d7-b185-517c90b48807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:34.230164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 531/1067] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:34.530459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd9c09-a13e-4e75-b47e-a2b5a77fe3f1 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:34.530740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd9c09-a13e-4e75-b47e-a2b5a77fe3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:34.531020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd9c09-a13e-4e75-b47e-a2b5a77fe3f1 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:34.532423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 537/1068] 10.222.0.15 () {54 vars in 962 bytes} [Mon Oct 24 13:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:34.538095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0812c-f1b5-4eee-8947-e39b3fc9c9ab None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:34.538375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0812c-f1b5-4eee-8947-e39b3fc9c9ab None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:34.538653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0812c-f1b5-4eee-8947-e39b3fc9c9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:34.555427 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:34.620121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d0d0812c-f1b5-4eee-8947-e39b3fc9c9ab None None] MFA Rules not processed for user `a47768a5f86d4c6292099691f6cab1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:34.621398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d0d0812c-f1b5-4eee-8947-e39b3fc9c9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:34.699297 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 532/1069] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Oct 24 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:34.707305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd9c09-a13e-4e75-b47e-a2b5a77fe3f1 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:34.708867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bedd9c09-a13e-4e75-b47e-a2b5a77fe3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:34.741082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:34.817785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd9c09-a13e-4e75-b47e-a2b5a77fe3f1 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:34.895437 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3ca6-47f1-4834-a210-335759b24f06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47768a5f86d4c6292099691f6cab1e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:34.896180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3ca6-47f1-4834-a210-335759b24f06 service glance] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:34.896496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3ca6-47f1-4834-a210-335759b24f06 service glance] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:34.896764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3ca6-47f1-4834-a210-335759b24f06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:34.898364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cfff3ca6-47f1-4834-a210-335759b24f06 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:34.979673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:35.012954 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3ca6-47f1-4834-a210-335759b24f06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:35.014520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3ca6-47f1-4834-a210-335759b24f06 service glance] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:35.033414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 538/1070] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:35.321445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65740e4-e73d-442b-ae35-16cb078d3773 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:35.321983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65740e4-e73d-442b-ae35-16cb078d3773 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:35.321983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65740e4-e73d-442b-ae35-16cb078d3773 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:35.324275 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 533/1071] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:35.330002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eddc7-0c34-4a63-8513-1b54fdf14462 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:35.330416 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eddc7-0c34-4a63-8513-1b54fdf14462 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:35.330593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eddc7-0c34-4a63-8513-1b54fdf14462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:35.410820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d21eddc7-0c34-4a63-8513-1b54fdf14462 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:35.412059 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d21eddc7-0c34-4a63-8513-1b54fdf14462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:35.521170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 539/1072] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:35.814860 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65740e4-e73d-442b-ae35-16cb078d3773 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:35.816398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f65740e4-e73d-442b-ae35-16cb078d3773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:35.821529 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13cafe-e00d-4c52-98e1-379ab7bf6ae2 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:35.822038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13cafe-e00d-4c52-98e1-379ab7bf6ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:35.822312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13cafe-e00d-4c52-98e1-379ab7bf6ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:35.872262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:35.897034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ad13cafe-e00d-4c52-98e1-379ab7bf6ae2 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:35.898824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ad13cafe-e00d-4c52-98e1-379ab7bf6ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:35.935922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:35.982269 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65740e4-e73d-442b-ae35-16cb078d3773 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:35.987654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 540/1073] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:05:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:05:36.039904 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b42c3e-8281-488f-8e44-c1a89574d8b9 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:36.040701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b42c3e-8281-488f-8e44-c1a89574d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:36.040979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b42c3e-8281-488f-8e44-c1a89574d8b9 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:36.042869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 541/1074] 10.222.0.15 () {54 vars in 943 bytes} [Mon Oct 24 13:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:36.050594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32ea5-b99f-4f67-8b27-dd2a7a977c19 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:36.050876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32ea5-b99f-4f67-8b27-dd2a7a977c19 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:36.051148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32ea5-b99f-4f67-8b27-dd2a7a977c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:36.123018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9c28-a335-4935-9ede-133a36391e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:36.124092 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9c28-a335-4935-9ede-133a36391e4a service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:36.124553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9c28-a335-4935-9ede-133a36391e4a service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:36.125003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9c28-a335-4935-9ede-133a36391e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:36.126805 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5c2b9c28-a335-4935-9ede-133a36391e4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:36.138013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-eae32ea5-b99f-4f67-8b27-dd2a7a977c19 None None] MFA Rules not processed for user `2e1fbb5f8a384aac98e17bd622e25eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:36.139316 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-eae32ea5-b99f-4f67-8b27-dd2a7a977c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:36.206972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:36.211588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:36.234802 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b9c28-a335-4935-9ede-133a36391e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:36.236954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b9c28-a335-4935-9ede-133a36391e4a service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:36.256495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 534/1075] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:36.258888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 542/1076] 10.222.0.15 () {58 vars in 1040 bytes} [Mon Oct 24 13:05:36 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:05:36.268129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9c28-a335-4935-9ede-133a36391e4a service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:36.269759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5c2b9c28-a335-4935-9ede-133a36391e4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:36.367493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9c28-a335-4935-9ede-133a36391e4a service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:36.481573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:36.483211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5984d16-fc42-4c8a-9b8e-a450e629bcec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:36.483901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5984d16-fc42-4c8a-9b8e-a450e629bcec service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:36.484219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5984d16-fc42-4c8a-9b8e-a450e629bcec service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:36.484767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5984d16-fc42-4c8a-9b8e-a450e629bcec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:36.487054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d5984d16-fc42-4c8a-9b8e-a450e629bcec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:36.577396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5984d16-fc42-4c8a-9b8e-a450e629bcec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:36.578922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5984d16-fc42-4c8a-9b8e-a450e629bcec service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:36.587487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 535/1077] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:05:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:05:38.451015 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57697ea7-3a82-41ff-92d7-3a24243446a3 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:38.451634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57697ea7-3a82-41ff-92d7-3a24243446a3 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:38.451634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57697ea7-3a82-41ff-92d7-3a24243446a3 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:38.452868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 543/1078] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:38.458387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cecb4b-b24c-4fae-b023-4b5a31e941b9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:38.458859 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cecb4b-b24c-4fae-b023-4b5a31e941b9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:38.458951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cecb4b-b24c-4fae-b023-4b5a31e941b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:38.534808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-44cecb4b-b24c-4fae-b023-4b5a31e941b9 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:38.536329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-44cecb4b-b24c-4fae-b023-4b5a31e941b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:38.636541 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:38.645696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 536/1079] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:38.936981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57697ea7-3a82-41ff-92d7-3a24243446a3 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:38.938515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-57697ea7-3a82-41ff-92d7-3a24243446a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:39.090533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57697ea7-3a82-41ff-92d7-3a24243446a3 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:39.136953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:39.216602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba811064-9469-4548-8fe4-8f77d9d81364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:39.217224 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811064-9469-4548-8fe4-8f77d9d81364 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:39.217504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811064-9469-4548-8fe4-8f77d9d81364 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:39.217771 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811064-9469-4548-8fe4-8f77d9d81364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:39.219368 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ba811064-9469-4548-8fe4-8f77d9d81364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:39.319446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba811064-9469-4548-8fe4-8f77d9d81364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:39.321126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba811064-9469-4548-8fe4-8f77d9d81364 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:39.340126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 544/1080] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:41.534946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1aefd4-46cf-4041-b9a1-57bce13ae067 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:41.535428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1aefd4-46cf-4041-b9a1-57bce13ae067 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:41.535519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1aefd4-46cf-4041-b9a1-57bce13ae067 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:41.541030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 537/1081] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:41.548599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc5ea-6010-4ca3-82e1-29d004a5adea None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:41.549168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc5ea-6010-4ca3-82e1-29d004a5adea None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:41.549168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc5ea-6010-4ca3-82e1-29d004a5adea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:41.634475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:41.647165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-6adcc5ea-6010-4ca3-82e1-29d004a5adea None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:41.648943 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6adcc5ea-6010-4ca3-82e1-29d004a5adea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:41.795720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 545/1082] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:42.085686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1aefd4-46cf-4041-b9a1-57bce13ae067 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:42.087300 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1f1aefd4-46cf-4041-b9a1-57bce13ae067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:42.256543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1aefd4-46cf-4041-b9a1-57bce13ae067 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:42.329130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:42.385977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e9f0f-6ffe-429b-9fcf-6aa86592136d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:42.387139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e9f0f-6ffe-429b-9fcf-6aa86592136d service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:42.387528 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e9f0f-6ffe-429b-9fcf-6aa86592136d service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:42.387799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e9f0f-6ffe-429b-9fcf-6aa86592136d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:42.389463 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-947e9f0f-6ffe-429b-9fcf-6aa86592136d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:42.490443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e9f0f-6ffe-429b-9fcf-6aa86592136d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:42.492129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e9f0f-6ffe-429b-9fcf-6aa86592136d service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:42.511839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 538/1083] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:05:44.736376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad0995-6b55-4dde-94fa-f1d25c4f895f None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:44.736983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad0995-6b55-4dde-94fa-f1d25c4f895f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:44.736983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad0995-6b55-4dde-94fa-f1d25c4f895f None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:44.738293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 546/1084] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:44.744335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003896e-10fc-45b0-aaf7-2bd6b26d8ae5 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:44.745160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003896e-10fc-45b0-aaf7-2bd6b26d8ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:44.745557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003896e-10fc-45b0-aaf7-2bd6b26d8ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:44.814845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d003896e-10fc-45b0-aaf7-2bd6b26d8ae5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:44.816073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d003896e-10fc-45b0-aaf7-2bd6b26d8ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:44.854218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:44.938020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 539/1085] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:45.219829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad0995-6b55-4dde-94fa-f1d25c4f895f None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:05:45.221389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9bad0995-6b55-4dde-94fa-f1d25c4f895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:45.348390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:45.382963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad0995-6b55-4dde-94fa-f1d25c4f895f None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:05:45.506341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba410e9-d3d8-459d-a48b-f8f15831681a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:05:45.506900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba410e9-d3d8-459d-a48b-f8f15831681a service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:45.507167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba410e9-d3d8-459d-a48b-f8f15831681a service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:45.507497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba410e9-d3d8-459d-a48b-f8f15831681a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:45.509139 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5ba410e9-d3d8-459d-a48b-f8f15831681a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:45.603305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:45.607696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba410e9-d3d8-459d-a48b-f8f15831681a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:05:45.609621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba410e9-d3d8-459d-a48b-f8f15831681a service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:05:45.630329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 547/1086] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:05:54.936328 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=30 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:55.627734 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=7 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:59.274165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb15d0c-40f0-492a-9f94-d2f35baa585a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:59.274780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb15d0c-40f0-492a-9f94-d2f35baa585a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:59.274780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb15d0c-40f0-492a-9f94-d2f35baa585a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:59.276058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 540/1087] 10.222.0.15 () {54 vars in 918 bytes} [Mon Oct 24 13:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:59.281481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a9221-6369-412e-b07a-bf3a7de06afb None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:59.281944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a9221-6369-412e-b07a-bf3a7de06afb None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:59.282049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a9221-6369-412e-b07a-bf3a7de06afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:59.371512 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9f4a9221-6369-412e-b07a-bf3a7de06afb None None] MFA Rules not processed for user `3a25b60f83d84fb38a759d6620c1c58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:59.372739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9f4a9221-6369-412e-b07a-bf3a7de06afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:59.496708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 548/1088] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Oct 24 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:05:59.517542 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84a825-18e3-4dbc-9af6-7c402a0f86ed None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:59.517876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84a825-18e3-4dbc-9af6-7c402a0f86ed None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:59.518216 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84a825-18e3-4dbc-9af6-7c402a0f86ed None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:59.520199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 541/1089] 10.222.0.15 () {54 vars in 918 bytes} [Mon Oct 24 13:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:05:59.525685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86439c18-dada-4d1c-8bc0-fdcea68eee85 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:05:59.525912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86439c18-dada-4d1c-8bc0-fdcea68eee85 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:05:59.526201 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86439c18-dada-4d1c-8bc0-fdcea68eee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:05:59.601889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:59.605525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-86439c18-dada-4d1c-8bc0-fdcea68eee85 None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:05:59.607593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-86439c18-dada-4d1c-8bc0-fdcea68eee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:05:59.733796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 549/1090] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Oct 24 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:02.341045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3df199-3bd8-442a-ba04-abc703f5b659 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:02.341959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3df199-3bd8-442a-ba04-abc703f5b659 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:02.341959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3df199-3bd8-442a-ba04-abc703f5b659 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:02.344144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 542/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:02.349790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b90583-56f8-416c-b118-1ca575e6f379 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:02.350272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b90583-56f8-416c-b118-1ca575e6f379 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:02.350384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b90583-56f8-416c-b118-1ca575e6f379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:02.418387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d0b90583-56f8-416c-b118-1ca575e6f379 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:02.419604 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d0b90583-56f8-416c-b118-1ca575e6f379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:02.484823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:02.528485 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 550/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:02.829791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3df199-3bd8-442a-ba04-abc703f5b659 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:02.831349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fd3df199-3bd8-442a-ba04-abc703f5b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:02.994337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3df199-3bd8-442a-ba04-abc703f5b659 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:03.064969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:03.105956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115602d-1945-4d3a-9b34-b8cf335954b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:03.106559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115602d-1945-4d3a-9b34-b8cf335954b1 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:03.106847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115602d-1945-4d3a-9b34-b8cf335954b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:03.107108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115602d-1945-4d3a-9b34-b8cf335954b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:03.108726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e115602d-1945-4d3a-9b34-b8cf335954b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:03.201126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115602d-1945-4d3a-9b34-b8cf335954b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:03.202733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115602d-1945-4d3a-9b34-b8cf335954b1 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:03.221455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 543/1093] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:04.355268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963604-c552-4ec3-867e-b4f4762212ff None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:04.356145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963604-c552-4ec3-867e-b4f4762212ff None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:04.356145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963604-c552-4ec3-867e-b4f4762212ff None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:04.358147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 551/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:04.366688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1a95-7ddd-4e1a-9db5-df12cfc70748 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:04.367114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1a95-7ddd-4e1a-9db5-df12cfc70748 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:04.367257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1a95-7ddd-4e1a-9db5-df12cfc70748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:04.451873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-28af1a95-7ddd-4e1a-9db5-df12cfc70748 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:04.453123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-28af1a95-7ddd-4e1a-9db5-df12cfc70748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:04.483818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:04.556645 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 544/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:04.709029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963604-c552-4ec3-867e-b4f4762212ff None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:04.710677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-33963604-c552-4ec3-867e-b4f4762212ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:04.864986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963604-c552-4ec3-867e-b4f4762212ff None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:04.906284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:04.992096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c71bf-5d03-4ed1-ab1a-98aba4c1a8b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:04.992352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c71bf-5d03-4ed1-ab1a-98aba4c1a8b0 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:04.992625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c71bf-5d03-4ed1-ab1a-98aba4c1a8b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:04.992903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c71bf-5d03-4ed1-ab1a-98aba4c1a8b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:04.994529 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c69c71bf-5d03-4ed1-ab1a-98aba4c1a8b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:05.088391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c71bf-5d03-4ed1-ab1a-98aba4c1a8b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:05.089878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c71bf-5d03-4ed1-ab1a-98aba4c1a8b0 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:05.108398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 552/1096] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:06.226898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88033e45-5794-45e3-9fe0-2ad422bc17ba None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:06.227508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88033e45-5794-45e3-9fe0-2ad422bc17ba None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:06.227508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88033e45-5794-45e3-9fe0-2ad422bc17ba None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:06.229665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 545/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:06.238048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761f1a3-f37e-47a9-9e92-957ae8062144 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:06.238824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761f1a3-f37e-47a9-9e92-957ae8062144 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:06.238980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761f1a3-f37e-47a9-9e92-957ae8062144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:06.296686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:06.321870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-1761f1a3-f37e-47a9-9e92-957ae8062144 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:06.323150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1761f1a3-f37e-47a9-9e92-957ae8062144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:06.419166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 553/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:06.574930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88033e45-5794-45e3-9fe0-2ad422bc17ba None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:06.576391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-88033e45-5794-45e3-9fe0-2ad422bc17ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:06.735538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88033e45-5794-45e3-9fe0-2ad422bc17ba None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:06.748329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:06.854143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994133ce-6797-488c-a698-7120e01e43f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:06.854766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994133ce-6797-488c-a698-7120e01e43f6 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:06.855046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994133ce-6797-488c-a698-7120e01e43f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:06.855317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994133ce-6797-488c-a698-7120e01e43f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:06.856951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-994133ce-6797-488c-a698-7120e01e43f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:06.949459 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994133ce-6797-488c-a698-7120e01e43f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:06.951063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994133ce-6797-488c-a698-7120e01e43f6 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:06.970110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 546/1099] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:08.059539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e262-cf2c-435c-b868-cdf4f82c65a2 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:08.060145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e262-cf2c-435c-b868-cdf4f82c65a2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:08.060145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e262-cf2c-435c-b868-cdf4f82c65a2 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:08.061513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 554/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:08.067660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3c1a4-2a78-462e-9308-7455494d6d38 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:08.068399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3c1a4-2a78-462e-9308-7455494d6d38 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:08.068575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3c1a4-2a78-462e-9308-7455494d6d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:08.090912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:08.151819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-56e3c1a4-2a78-462e-9308-7455494d6d38 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:08.153080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-56e3c1a4-2a78-462e-9308-7455494d6d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:08.260857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 547/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:08.409623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7e262-cf2c-435c-b868-cdf4f82c65a2 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:08.411729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-20a7e262-cf2c-435c-b868-cdf4f82c65a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:08.530921 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:08.566564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7e262-cf2c-435c-b868-cdf4f82c65a2 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:08.691098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc17cf-e638-4f8e-ab81-d767cd73d76c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:08.691639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc17cf-e638-4f8e-ab81-d767cd73d76c service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:08.691915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc17cf-e638-4f8e-ab81-d767cd73d76c service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:08.692182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc17cf-e638-4f8e-ab81-d767cd73d76c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:08.693812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f1cc17cf-e638-4f8e-ab81-d767cd73d76c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:08.773942 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:08.788017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc17cf-e638-4f8e-ab81-d767cd73d76c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:08.789653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc17cf-e638-4f8e-ab81-d767cd73d76c service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:08.807531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 555/1102] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:09.914889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daedec4-a84d-4398-a5f7-c9bf06fad0ea None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:09.915474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daedec4-a84d-4398-a5f7-c9bf06fad0ea None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:09.915474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daedec4-a84d-4398-a5f7-c9bf06fad0ea None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:09.917534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 548/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:09.925776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa95c36-1385-4cf2-b4f7-c05538845204 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:09.926193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa95c36-1385-4cf2-b4f7-c05538845204 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:09.926371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa95c36-1385-4cf2-b4f7-c05538845204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:10.006473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-aaa95c36-1385-4cf2-b4f7-c05538845204 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:10.007612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-aaa95c36-1385-4cf2-b4f7-c05538845204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:10.109514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 556/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:10.263262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daedec4-a84d-4398-a5f7-c9bf06fad0ea None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:10.265475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1daedec4-a84d-4398-a5f7-c9bf06fad0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:10.366569 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:10.426936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daedec4-a84d-4398-a5f7-c9bf06fad0ea None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:10.542189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5baff-331f-4613-89eb-7a4d4c87d0fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:10.542692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5baff-331f-4613-89eb-7a4d4c87d0fe service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:10.542964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5baff-331f-4613-89eb-7a4d4c87d0fe service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:10.543227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5baff-331f-4613-89eb-7a4d4c87d0fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:10.544843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-89b5baff-331f-4613-89eb-7a4d4c87d0fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:10.599492 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:10.647707 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5baff-331f-4613-89eb-7a4d4c87d0fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:10.649350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5baff-331f-4613-89eb-7a4d4c87d0fe service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:10.668081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 549/1105] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:11.715862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2dc1a-791a-4a1c-942e-29451617f411 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:11.716513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2dc1a-791a-4a1c-942e-29451617f411 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:11.716513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2dc1a-791a-4a1c-942e-29451617f411 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:11.717833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 557/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:11.723902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c6192-1525-4c87-a52d-2739969a1aee None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:11.724387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c6192-1525-4c87-a52d-2739969a1aee None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:11.724506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c6192-1525-4c87-a52d-2739969a1aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:11.802429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8a5c6192-1525-4c87-a52d-2739969a1aee None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:11.803661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8a5c6192-1525-4c87-a52d-2739969a1aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:11.903524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 550/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:12.057309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2dc1a-791a-4a1c-942e-29451617f411 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:12.059723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-73b2dc1a-791a-4a1c-942e-29451617f411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:12.124229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:12.225743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2dc1a-791a-4a1c-942e-29451617f411 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:12.342564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802be5fc-279f-4f0b-8851-98fe6a663ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:12.343179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be5fc-279f-4f0b-8851-98fe6a663ecc service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:12.343453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be5fc-279f-4f0b-8851-98fe6a663ecc service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:12.343724 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be5fc-279f-4f0b-8851-98fe6a663ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:12.345344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-802be5fc-279f-4f0b-8851-98fe6a663ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:12.352848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:12.446452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802be5fc-279f-4f0b-8851-98fe6a663ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:12.448063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802be5fc-279f-4f0b-8851-98fe6a663ecc service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:12.466434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 558/1108] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:13.503480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3859-861d-4f3a-9a02-319465a708d2 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:13.504429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3859-861d-4f3a-9a02-319465a708d2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:13.504429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3859-861d-4f3a-9a02-319465a708d2 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:13.506474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 551/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:13.512488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c7c5-5ba6-41f0-b499-84caf0e08e07 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:13.512917 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c7c5-5ba6-41f0-b499-84caf0e08e07 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:13.513052 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c7c5-5ba6-41f0-b499-84caf0e08e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:13.596464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-0706c7c5-5ba6-41f0-b499-84caf0e08e07 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:13.597570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0706c7c5-5ba6-41f0-b499-84caf0e08e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:13.676246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:13.705231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 559/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:13.857472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d3859-861d-4f3a-9a02-319465a708d2 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:13.858898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-925d3859-861d-4f3a-9a02-319465a708d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:13.878264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:14.025559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d3859-861d-4f3a-9a02-319465a708d2 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:14.119336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:14.146394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acf726-bd23-4c88-ad65-73bed1679cf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:14.147008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acf726-bd23-4c88-ad65-73bed1679cf8 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:14.147292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acf726-bd23-4c88-ad65-73bed1679cf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:14.147547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acf726-bd23-4c88-ad65-73bed1679cf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:14.149166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e8acf726-bd23-4c88-ad65-73bed1679cf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:14.241699 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acf726-bd23-4c88-ad65-73bed1679cf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:14.243286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acf726-bd23-4c88-ad65-73bed1679cf8 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:14.262307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 552/1111] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:06:15.288306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0eb08-707d-430d-8203-372339f76ca3 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:15.289240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0eb08-707d-430d-8203-372339f76ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:15.289240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0eb08-707d-430d-8203-372339f76ca3 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:15.291385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 560/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:15.296715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0078e93-f218-465c-a719-b1e333730176 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:15.297194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0078e93-f218-465c-a719-b1e333730176 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:15.297194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0078e93-f218-465c-a719-b1e333730176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:15.377369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f0078e93-f218-465c-a719-b1e333730176 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:15.378592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f0078e93-f218-465c-a719-b1e333730176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:15.425126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:15.481124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 553/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:15.642867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0eb08-707d-430d-8203-372339f76ca3 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:15.645194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-fed0eb08-707d-430d-8203-372339f76ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:15.802154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0eb08-707d-430d-8203-372339f76ca3 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:15.863784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:15.923745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320060ef-d8ad-41a2-8a98-01cf29c622ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:15.924412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320060ef-d8ad-41a2-8a98-01cf29c622ec service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:15.924697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320060ef-d8ad-41a2-8a98-01cf29c622ec service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:15.924968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320060ef-d8ad-41a2-8a98-01cf29c622ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:15.926601 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-320060ef-d8ad-41a2-8a98-01cf29c622ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:16.024573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320060ef-d8ad-41a2-8a98-01cf29c622ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:16.026169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320060ef-d8ad-41a2-8a98-01cf29c622ec service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:16.045712 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 561/1114] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:17.085940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b4aba-9ba3-4b39-8816-615f5dfde904 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:17.086684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b4aba-9ba3-4b39-8816-615f5dfde904 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:17.086684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b4aba-9ba3-4b39-8816-615f5dfde904 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:17.088656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 554/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:06:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:17.096742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768502a-be09-404f-a895-f436d708b5b8 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:17.097143 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768502a-be09-404f-a895-f436d708b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:17.097235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768502a-be09-404f-a895-f436d708b5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:17.179997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8768502a-be09-404f-a895-f436d708b5b8 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:17.181240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8768502a-be09-404f-a895-f436d708b5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:17.183434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:17.284723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 562/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:17.433497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b4aba-9ba3-4b39-8816-615f5dfde904 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:17.435717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e44b4aba-9ba3-4b39-8816-615f5dfde904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:17.594383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b4aba-9ba3-4b39-8816-615f5dfde904 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:17.623066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:17.717794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5836b4-9a70-46e9-ab42-9e34c301f6f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:17.718324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5836b4-9a70-46e9-ab42-9e34c301f6f4 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:17.718602 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5836b4-9a70-46e9-ab42-9e34c301f6f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:17.718866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5836b4-9a70-46e9-ab42-9e34c301f6f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:17.720469 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bb5836b4-9a70-46e9-ab42-9e34c301f6f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:17.812868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5836b4-9a70-46e9-ab42-9e34c301f6f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:17.814469 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5836b4-9a70-46e9-ab42-9e34c301f6f4 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:17.833803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 555/1117] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:19.860751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956277dd-eeb1-40c0-9ddb-f872e1fb726e None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:19.861514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956277dd-eeb1-40c0-9ddb-f872e1fb726e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:19.861705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956277dd-eeb1-40c0-9ddb-f872e1fb726e None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:19.864191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 563/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:19.870518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496df9e-f286-4777-96b6-875a5f128f07 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:19.870975 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496df9e-f286-4777-96b6-875a5f128f07 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:19.871086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496df9e-f286-4777-96b6-875a5f128f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:19.922370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:19.959646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f496df9e-f286-4777-96b6-875a5f128f07 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:19.960900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f496df9e-f286-4777-96b6-875a5f128f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:20.061577 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 556/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:20.339984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956277dd-eeb1-40c0-9ddb-f872e1fb726e None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:20.341609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-956277dd-eeb1-40c0-9ddb-f872e1fb726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:20.452572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956277dd-eeb1-40c0-9ddb-f872e1fb726e None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:20.485038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:20.529526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0495a-5b5a-4e34-a267-e54998cad8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:20.530287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0495a-5b5a-4e34-a267-e54998cad8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:20.530568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0495a-5b5a-4e34-a267-e54998cad8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:20.530956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0495a-5b5a-4e34-a267-e54998cad8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:20.533010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-01d0495a-5b5a-4e34-a267-e54998cad8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:20.651514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0495a-5b5a-4e34-a267-e54998cad8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:20.653006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0495a-5b5a-4e34-a267-e54998cad8e7 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:20.672013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 564/1120] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:22.978765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c12dc-a6e5-4bb0-9ca2-93cf3c18c2e2 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:22.979617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c12dc-a6e5-4bb0-9ca2-93cf3c18c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:22.979617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c12dc-a6e5-4bb0-9ca2-93cf3c18c2e2 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:22.981892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 557/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:22.991301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256a96d-ee55-4eae-9e55-acb00eabcb46 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:22.991731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256a96d-ee55-4eae-9e55-acb00eabcb46 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:22.991869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256a96d-ee55-4eae-9e55-acb00eabcb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:23.065838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4256a96d-ee55-4eae-9e55-acb00eabcb46 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:23.067056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4256a96d-ee55-4eae-9e55-acb00eabcb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:23.080200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:23.175716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 565/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:23.471954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c12dc-a6e5-4bb0-9ca2-93cf3c18c2e2 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:23.474483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-da7c12dc-a6e5-4bb0-9ca2-93cf3c18c2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:23.590833 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c12dc-a6e5-4bb0-9ca2-93cf3c18c2e2 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:23.603723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:23.673529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779b88-8538-4ea4-ac0b-73cd98245668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:23.674342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779b88-8538-4ea4-ac0b-73cd98245668 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:23.674655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779b88-8538-4ea4-ac0b-73cd98245668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:23.674954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779b88-8538-4ea4-ac0b-73cd98245668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:23.677469 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3f779b88-8538-4ea4-ac0b-73cd98245668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:23.793418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f779b88-8538-4ea4-ac0b-73cd98245668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:23.794780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f779b88-8538-4ea4-ac0b-73cd98245668 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:23.813541 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 558/1123] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:26.275210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dbc91-3825-49a8-bc4e-1a5bd76114c9 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:26.275792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dbc91-3825-49a8-bc4e-1a5bd76114c9 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:26.275792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dbc91-3825-49a8-bc4e-1a5bd76114c9 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:26.277147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 566/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:26.283379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aae1b-bea9-4b6a-bad2-a33c4bae6950 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:26.283846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aae1b-bea9-4b6a-bad2-a33c4bae6950 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:26.283942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aae1b-bea9-4b6a-bad2-a33c4bae6950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:26.336811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:26.357689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ad0aae1b-bea9-4b6a-bad2-a33c4bae6950 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:26.358898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ad0aae1b-bea9-4b6a-bad2-a33c4bae6950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:26.460840 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 559/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:26.748846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dbc91-3825-49a8-bc4e-1a5bd76114c9 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:26.750395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2d6dbc91-3825-49a8-bc4e-1a5bd76114c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:26.857674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dbc91-3825-49a8-bc4e-1a5bd76114c9 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:26.898974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:26.934059 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98993df-edfc-427e-a916-f00fba09e263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:26.934698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98993df-edfc-427e-a916-f00fba09e263 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:26.934969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98993df-edfc-427e-a916-f00fba09e263 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:26.935234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98993df-edfc-427e-a916-f00fba09e263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:26.936849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e98993df-edfc-427e-a916-f00fba09e263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:27.055828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98993df-edfc-427e-a916-f00fba09e263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:27.057219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98993df-edfc-427e-a916-f00fba09e263 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:27.075309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 567/1126] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:29.341740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf960df-cfe5-4135-95f9-ddbcb49e1eb3 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:29.342340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf960df-cfe5-4135-95f9-ddbcb49e1eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:29.342340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf960df-cfe5-4135-95f9-ddbcb49e1eb3 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:29.344054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 560/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:29.350287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e1c21-21ae-4424-9358-71a52e27e5dc None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:29.350756 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e1c21-21ae-4424-9358-71a52e27e5dc None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:29.350864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e1c21-21ae-4424-9358-71a52e27e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:29.434655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ee9e1c21-21ae-4424-9358-71a52e27e5dc None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:29.435877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ee9e1c21-21ae-4424-9358-71a52e27e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:29.457460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:29.539458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 568/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:29.820725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf960df-cfe5-4135-95f9-ddbcb49e1eb3 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:29.823142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0cf960df-cfe5-4135-95f9-ddbcb49e1eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:29.938950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf960df-cfe5-4135-95f9-ddbcb49e1eb3 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:29.961785 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:30.017210 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feda535-be93-4f79-88fa-e33d2ab1b136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:30.017813 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feda535-be93-4f79-88fa-e33d2ab1b136 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:30.018086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feda535-be93-4f79-88fa-e33d2ab1b136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:30.018351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feda535-be93-4f79-88fa-e33d2ab1b136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:30.019927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2feda535-be93-4f79-88fa-e33d2ab1b136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:30.136863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feda535-be93-4f79-88fa-e33d2ab1b136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:30.138227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feda535-be93-4f79-88fa-e33d2ab1b136 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:30.157554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 561/1129] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:32.437700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca67029-73f9-49ec-a444-1a5873bc6136 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:32.438275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca67029-73f9-49ec-a444-1a5873bc6136 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:32.438275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca67029-73f9-49ec-a444-1a5873bc6136 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:32.439627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 569/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:32.446499 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85d99d-5273-4eaa-adb8-c89ead4b08ec None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:32.446965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85d99d-5273-4eaa-adb8-c89ead4b08ec None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:32.447070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85d99d-5273-4eaa-adb8-c89ead4b08ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:32.516500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:32.519351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-da85d99d-5273-4eaa-adb8-c89ead4b08ec None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:32.521069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-da85d99d-5273-4eaa-adb8-c89ead4b08ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:32.619448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 562/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:32.898961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca67029-73f9-49ec-a444-1a5873bc6136 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:32.901464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7ca67029-73f9-49ec-a444-1a5873bc6136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:33.010254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca67029-73f9-49ec-a444-1a5873bc6136 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:33.060080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:33.085333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3a2d6-f2ea-46c3-a619-8936fab1f64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:33.085959 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3a2d6-f2ea-46c3-a619-8936fab1f64e service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:33.086236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3a2d6-f2ea-46c3-a619-8936fab1f64e service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:33.086508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3a2d6-f2ea-46c3-a619-8936fab1f64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:33.088093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-21c3a2d6-f2ea-46c3-a619-8936fab1f64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:33.198813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3a2d6-f2ea-46c3-a619-8936fab1f64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:33.200251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3a2d6-f2ea-46c3-a619-8936fab1f64e service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:33.220342 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 570/1132] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:35.431655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043ca74-70e0-4b66-b124-4464e208a0bb None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:35.432282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043ca74-70e0-4b66-b124-4464e208a0bb None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:35.432282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043ca74-70e0-4b66-b124-4464e208a0bb None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:35.433586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 563/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:35.440196 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09be33-6ce0-4f29-938b-6a126af55b75 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:35.440896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09be33-6ce0-4f29-938b-6a126af55b75 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:35.441060 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09be33-6ce0-4f29-938b-6a126af55b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:35.516264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-7c09be33-6ce0-4f29-938b-6a126af55b75 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:35.517508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7c09be33-6ce0-4f29-938b-6a126af55b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:35.546451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:35.620112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 571/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:35.910782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043ca74-70e0-4b66-b124-4464e208a0bb None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:35.912536 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6043ca74-70e0-4b66-b124-4464e208a0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:36.022633 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043ca74-70e0-4b66-b124-4464e208a0bb None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:36.052799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:36.100023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be685604-9d64-4bfb-8ad8-86bf15da95be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:36.100606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be685604-9d64-4bfb-8ad8-86bf15da95be service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:36.100904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be685604-9d64-4bfb-8ad8-86bf15da95be service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:36.101148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be685604-9d64-4bfb-8ad8-86bf15da95be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:36.102769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-be685604-9d64-4bfb-8ad8-86bf15da95be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:36.221080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be685604-9d64-4bfb-8ad8-86bf15da95be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:36.222537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be685604-9d64-4bfb-8ad8-86bf15da95be service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:36.242550 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 564/1135] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:38.449045 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0940c6-b3b0-43cb-9596-7dc8301fa92b None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:38.449631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0940c6-b3b0-43cb-9596-7dc8301fa92b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:38.449631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0940c6-b3b0-43cb-9596-7dc8301fa92b None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:38.450866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 572/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:06:38.457433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631605d3-b04b-443d-91ed-84eec7378687 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:38.457897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631605d3-b04b-443d-91ed-84eec7378687 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:38.458028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631605d3-b04b-443d-91ed-84eec7378687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:38.530482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-631605d3-b04b-443d-91ed-84eec7378687 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:38.531705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-631605d3-b04b-443d-91ed-84eec7378687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:38.540184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:38.639825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 565/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:38.922724 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0940c6-b3b0-43cb-9596-7dc8301fa92b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:38.925115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1a0940c6-b3b0-43cb-9596-7dc8301fa92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:39.039360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0940c6-b3b0-43cb-9596-7dc8301fa92b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:39.095618 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:39.113629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f8130-45f6-4929-9c5d-11299814c141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:39.114160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8130-45f6-4929-9c5d-11299814c141 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:39.114434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8130-45f6-4929-9c5d-11299814c141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:39.114756 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8130-45f6-4929-9c5d-11299814c141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:39.116329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c94f8130-45f6-4929-9c5d-11299814c141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:39.225553 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f8130-45f6-4929-9c5d-11299814c141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:39.226992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f8130-45f6-4929-9c5d-11299814c141 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:39.245517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 573/1138] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:41.422188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8e51-4f13-4cb6-8075-e379b4d03676 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:41.423161 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8e51-4f13-4cb6-8075-e379b4d03676 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:41.423161 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8e51-4f13-4cb6-8075-e379b4d03676 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:41.425383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 566/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:41.432742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b3a30-3a5f-45fb-920f-eadc53812c3c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:41.433205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b3a30-3a5f-45fb-920f-eadc53812c3c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:41.433307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b3a30-3a5f-45fb-920f-eadc53812c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:41.512204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-aa7b3a30-3a5f-45fb-920f-eadc53812c3c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:41.513439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-aa7b3a30-3a5f-45fb-920f-eadc53812c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:41.558919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:41.622560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 574/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:41.905617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8e51-4f13-4cb6-8075-e379b4d03676 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:41.907914 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f18f8e51-4f13-4cb6-8075-e379b4d03676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:42.018007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8e51-4f13-4cb6-8075-e379b4d03676 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:42.058322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:42.102795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b276154-e3c3-4ad6-872f-3f3e88977471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:42.103455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b276154-e3c3-4ad6-872f-3f3e88977471 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:42.103770 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b276154-e3c3-4ad6-872f-3f3e88977471 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:42.104105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b276154-e3c3-4ad6-872f-3f3e88977471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:42.106508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0b276154-e3c3-4ad6-872f-3f3e88977471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:42.222288 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b276154-e3c3-4ad6-872f-3f3e88977471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:42.223717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b276154-e3c3-4ad6-872f-3f3e88977471 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:42.242629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 567/1141] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:44.404457 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab3a22-58da-433d-94e0-8c8bd877e4c2 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:44.405369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab3a22-58da-433d-94e0-8c8bd877e4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:44.405369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab3a22-58da-433d-94e0-8c8bd877e4c2 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:44.407512 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 575/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:44.413166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7639ba-5146-4aec-8d7b-8ac700ec0a97 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:44.413622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7639ba-5146-4aec-8d7b-8ac700ec0a97 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:44.413735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7639ba-5146-4aec-8d7b-8ac700ec0a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:44.481698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ff7639ba-5146-4aec-8d7b-8ac700ec0a97 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:44.482909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ff7639ba-5146-4aec-8d7b-8ac700ec0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:44.501398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:44.581385 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 568/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:44.860184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab3a22-58da-433d-94e0-8c8bd877e4c2 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:44.861797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-48ab3a22-58da-433d-94e0-8c8bd877e4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:44.973884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab3a22-58da-433d-94e0-8c8bd877e4c2 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:45.046144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:45.054336 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9643c-c362-4555-aec3-181e4cb4a41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:45.055173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9643c-c362-4555-aec3-181e4cb4a41c service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:45.055561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9643c-c362-4555-aec3-181e4cb4a41c service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:45.055896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9643c-c362-4555-aec3-181e4cb4a41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:45.058541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3ec9643c-c362-4555-aec3-181e4cb4a41c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:45.179819 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9643c-c362-4555-aec3-181e4cb4a41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:45.181588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9643c-c362-4555-aec3-181e4cb4a41c service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:45.206995 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 576/1144] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:47.349558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b132c-1af6-4b16-9ff6-c4520e25fe51 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:47.350173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b132c-1af6-4b16-9ff6-c4520e25fe51 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:47.350173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b132c-1af6-4b16-9ff6-c4520e25fe51 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:47.351501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 569/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:06:47.358263 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ce39b-46a4-42aa-80a1-281a74cb0b05 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:47.359005 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ce39b-46a4-42aa-80a1-281a74cb0b05 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:47.359146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ce39b-46a4-42aa-80a1-281a74cb0b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:47.436165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5d3ce39b-46a4-42aa-80a1-281a74cb0b05 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:06:47.437414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5d3ce39b-46a4-42aa-80a1-281a74cb0b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:47.493603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:47.547461 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 577/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:06:47.828771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b132c-1af6-4b16-9ff6-c4520e25fe51 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:06:47.831219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-894b132c-1af6-4b16-9ff6-c4520e25fe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:47.945509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b132c-1af6-4b16-9ff6-c4520e25fe51 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:06:47.999185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:48.026450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306f92f-14dd-4d71-9faa-ab14daadd114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:06:48.027063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306f92f-14dd-4d71-9faa-ab14daadd114 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:06:48.027339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306f92f-14dd-4d71-9faa-ab14daadd114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:06:48.027609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306f92f-14dd-4d71-9faa-ab14daadd114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:06:48.029236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c306f92f-14dd-4d71-9faa-ab14daadd114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:06:48.146186 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306f92f-14dd-4d71-9faa-ab14daadd114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:06:48.147883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306f92f-14dd-4d71-9faa-ab14daadd114 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:06:48.167177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 570/1147] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:57.545747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=22 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:58.164898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=66 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:07.909537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28c42e-a53a-41fe-8338-ada9752a5d5e None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:07.910112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28c42e-a53a-41fe-8338-ada9752a5d5e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:07.910112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28c42e-a53a-41fe-8338-ada9752a5d5e None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:07.911451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 578/1148] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:07.917883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eca52-740b-4d9e-9e04-3de069ba6dbe None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:07.918592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eca52-740b-4d9e-9e04-3de069ba6dbe None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:07.918815 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eca52-740b-4d9e-9e04-3de069ba6dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:07.997179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b86eca52-740b-4d9e-9e04-3de069ba6dbe None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:07.998400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b86eca52-740b-4d9e-9e04-3de069ba6dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:08.115335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 571/1149] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:08.410692 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b1e79-4d14-4539-8af2-24d97320fea4 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:08.411034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b1e79-4d14-4539-8af2-24d97320fea4 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:08.411413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b1e79-4d14-4539-8af2-24d97320fea4 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:08.413592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 579/1150] 10.222.0.15 () {54 vars in 962 bytes} [Mon Oct 24 13:07:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:08.419743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866084cd-41e6-4931-863a-77aaf2267eb0 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:08.420143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866084cd-41e6-4931-863a-77aaf2267eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:08.420581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866084cd-41e6-4931-863a-77aaf2267eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:08.503024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-866084cd-41e6-4931-863a-77aaf2267eb0 None None] MFA Rules not processed for user `a47768a5f86d4c6292099691f6cab1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:08.504224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-866084cd-41e6-4931-863a-77aaf2267eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:08.528122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:08.587680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 572/1151] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Oct 24 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:08.596037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b1e79-4d14-4539-8af2-24d97320fea4 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:08.597678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-275b1e79-4d14-4539-8af2-24d97320fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:08.717515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b1e79-4d14-4539-8af2-24d97320fea4 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:08.799745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7eea8e-ac54-4e12-97c6-c5f2da8e36a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47768a5f86d4c6292099691f6cab1e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:08.800384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eea8e-ac54-4e12-97c6-c5f2da8e36a3 service glance] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:08.800666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eea8e-ac54-4e12-97c6-c5f2da8e36a3 service glance] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:08.800938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eea8e-ac54-4e12-97c6-c5f2da8e36a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:08.802532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8d7eea8e-ac54-4e12-97c6-c5f2da8e36a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:08.859476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:08.919425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7eea8e-ac54-4e12-97c6-c5f2da8e36a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:08.920920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7eea8e-ac54-4e12-97c6-c5f2da8e36a3 service glance] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:08.945303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 580/1152] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:11.180005 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0611dd-6faa-405d-8f34-c2b01dba2a89 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:11.181180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0611dd-6faa-405d-8f34-c2b01dba2a89 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:11.181180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0611dd-6faa-405d-8f34-c2b01dba2a89 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:11.183142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 573/1153] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:07:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:11.189775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06719cd8-7f5b-4305-8496-dd1cf8965f65 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:11.190255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06719cd8-7f5b-4305-8496-dd1cf8965f65 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:11.190373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06719cd8-7f5b-4305-8496-dd1cf8965f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:11.259191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-06719cd8-7f5b-4305-8496-dd1cf8965f65 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:11.260413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-06719cd8-7f5b-4305-8496-dd1cf8965f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:11.358875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 581/1154] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:11.627963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0611dd-6faa-405d-8f34-c2b01dba2a89 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:11.629544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cb0611dd-6faa-405d-8f34-c2b01dba2a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:11.760225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0611dd-6faa-405d-8f34-c2b01dba2a89 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:11.812710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:11.862217 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b94f4-e640-4b1e-9cc0-9786a9853255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:11.862842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b94f4-e640-4b1e-9cc0-9786a9853255 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:11.863124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b94f4-e640-4b1e-9cc0-9786a9853255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:11.863400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b94f4-e640-4b1e-9cc0-9786a9853255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:11.864055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b94f4-e640-4b1e-9cc0-9786a9853255 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:11.865620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING py.warnings [None req-ce9b94f4-e640-4b1e-9cc0-9786a9853255 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:07:11.865620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: warnings.warn(msg) Oct 24 13:07:11.865620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: Oct 24 13:07:11.866789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b94f4-e640-4b1e-9cc0-9786a9853255 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:11.886389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 574/1155] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Oct 24 13:07:11 2022] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:07:14.035424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d7b0d-0368-43c2-bff1-0ab46a019c68 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:14.036373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d7b0d-0368-43c2-bff1-0ab46a019c68 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:14.036373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d7b0d-0368-43c2-bff1-0ab46a019c68 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:14.038518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 582/1156] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:07:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:14.044066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2de2-29a1-40b9-a290-c99a632d35a6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:14.044563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2de2-29a1-40b9-a290-c99a632d35a6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:14.044664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2de2-29a1-40b9-a290-c99a632d35a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:14.111378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-6dee2de2-29a1-40b9-a290-c99a632d35a6 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:14.112683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6dee2de2-29a1-40b9-a290-c99a632d35a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:14.212438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 575/1157] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:14.516744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d7b0d-0368-43c2-bff1-0ab46a019c68 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:14.519621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f36d7b0d-0368-43c2-bff1-0ab46a019c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:14.531381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:14.671949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d7b0d-0368-43c2-bff1-0ab46a019c68 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:14.766611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:14.801091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e3b55-6ad4-4a68-9ebd-6d6bf2efc85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:14.801697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3b55-6ad4-4a68-9ebd-6d6bf2efc85f service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:14.801969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3b55-6ad4-4a68-9ebd-6d6bf2efc85f service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:14.802235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3b55-6ad4-4a68-9ebd-6d6bf2efc85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:14.803829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5e4e3b55-6ad4-4a68-9ebd-6d6bf2efc85f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:14.898974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e3b55-6ad4-4a68-9ebd-6d6bf2efc85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:14.900608 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e3b55-6ad4-4a68-9ebd-6d6bf2efc85f service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:14.920319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 583/1158] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:17.262917 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018ff54-e751-4a2d-8e0f-66d2e96e6611 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:17.263523 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018ff54-e751-4a2d-8e0f-66d2e96e6611 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:17.263523 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018ff54-e751-4a2d-8e0f-66d2e96e6611 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:17.265572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 576/1159] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:07:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:07:17.273585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744ee2-d634-475d-a6ae-0b3ec338bd4e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:17.274071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744ee2-d634-475d-a6ae-0b3ec338bd4e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:17.274071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744ee2-d634-475d-a6ae-0b3ec338bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:17.343389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-86744ee2-d634-475d-a6ae-0b3ec338bd4e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:17.344616 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-86744ee2-d634-475d-a6ae-0b3ec338bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:17.394739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:17.448854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 584/1160] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:17.729790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018ff54-e751-4a2d-8e0f-66d2e96e6611 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:17.731325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9018ff54-e751-4a2d-8e0f-66d2e96e6611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:17.755964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:17.843250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018ff54-e751-4a2d-8e0f-66d2e96e6611 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:17.923155 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575c82e-cba5-4050-9632-80be861cfa83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:17.923763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575c82e-cba5-4050-9632-80be861cfa83 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:17.924038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575c82e-cba5-4050-9632-80be861cfa83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:17.924331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575c82e-cba5-4050-9632-80be861cfa83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:17.925903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0575c82e-cba5-4050-9632-80be861cfa83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:18.002424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:18.037634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575c82e-cba5-4050-9632-80be861cfa83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:18.039157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575c82e-cba5-4050-9632-80be861cfa83 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:18.058260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 577/1161] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:20.233625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6d771-bd1a-45d3-8dd6-f258129f9472 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:20.234544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6d771-bd1a-45d3-8dd6-f258129f9472 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:20.234544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6d771-bd1a-45d3-8dd6-f258129f9472 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:20.236709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 585/1162] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:07:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:20.245818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41749562-0377-4f46-9831-bf3dad1b088b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:20.246252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41749562-0377-4f46-9831-bf3dad1b088b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:20.246381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41749562-0377-4f46-9831-bf3dad1b088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:20.315937 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-41749562-0377-4f46-9831-bf3dad1b088b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:20.317172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-41749562-0377-4f46-9831-bf3dad1b088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:20.416812 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 578/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:20.699218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6d771-bd1a-45d3-8dd6-f258129f9472 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:20.700881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-28a6d771-bd1a-45d3-8dd6-f258129f9472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:20.818677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6d771-bd1a-45d3-8dd6-f258129f9472 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:20.894180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:20.895734 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77673a8d-3ee9-419a-b71e-2c374f7f2634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:20.896381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673a8d-3ee9-419a-b71e-2c374f7f2634 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:20.896679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673a8d-3ee9-419a-b71e-2c374f7f2634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:20.896955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673a8d-3ee9-419a-b71e-2c374f7f2634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:20.899314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-77673a8d-3ee9-419a-b71e-2c374f7f2634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:21.014510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77673a8d-3ee9-419a-b71e-2c374f7f2634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:21.015871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77673a8d-3ee9-419a-b71e-2c374f7f2634 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:21.034388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 586/1164] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:23.323793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb88e0-8798-4b04-a06e-e2422f857e75 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:23.324789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb88e0-8798-4b04-a06e-e2422f857e75 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:23.324789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb88e0-8798-4b04-a06e-e2422f857e75 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:23.326967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 579/1165] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:07:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:23.335889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d5ec-5df9-48c3-b5fd-3d1a6d40188b None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:23.336305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d5ec-5df9-48c3-b5fd-3d1a6d40188b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:23.336458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d5ec-5df9-48c3-b5fd-3d1a6d40188b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:23.406137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-7d92d5ec-5df9-48c3-b5fd-3d1a6d40188b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:23.407336 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7d92d5ec-5df9-48c3-b5fd-3d1a6d40188b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:23.463056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:23.516176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 587/1166] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:23.806837 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb88e0-8798-4b04-a06e-e2422f857e75 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:23.809376 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-63bb88e0-8798-4b04-a06e-e2422f857e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:23.851472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:23.929562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb88e0-8798-4b04-a06e-e2422f857e75 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:24.003493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754125f-ca75-4057-aa1d-636df2ee0d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:24.004096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754125f-ca75-4057-aa1d-636df2ee0d49 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:24.004398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754125f-ca75-4057-aa1d-636df2ee0d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:24.004668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754125f-ca75-4057-aa1d-636df2ee0d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:24.006233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7754125f-ca75-4057-aa1d-636df2ee0d49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:24.101264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:24.131745 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754125f-ca75-4057-aa1d-636df2ee0d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:24.133226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754125f-ca75-4057-aa1d-636df2ee0d49 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:24.152717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 580/1167] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:26.608386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b92c-bbcb-457a-8555-f60dc822d5e7 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:26.609015 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b92c-bbcb-457a-8555-f60dc822d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:26.609015 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b92c-bbcb-457a-8555-f60dc822d5e7 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:26.610339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 588/1168] 10.222.0.15 () {54 vars in 927 bytes} [Mon Oct 24 13:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:07:26.618144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6470037-aad5-44c0-9f75-1244b1000010 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:26.618608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6470037-aad5-44c0-9f75-1244b1000010 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:26.618718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6470037-aad5-44c0-9f75-1244b1000010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:26.686964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c6470037-aad5-44c0-9f75-1244b1000010 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:07:26.688177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c6470037-aad5-44c0-9f75-1244b1000010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:26.798669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 581/1169] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Oct 24 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:07:27.086661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b92c-bbcb-457a-8555-f60dc822d5e7 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:07:27.088968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-73b0b92c-bbcb-457a-8555-f60dc822d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:27.204153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b92c-bbcb-457a-8555-f60dc822d5e7 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:07:27.281827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54620beb-875e-4159-9a07-27045d9fabe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:07:27.282433 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620beb-875e-4159-9a07-27045d9fabe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:07:27.282711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620beb-875e-4159-9a07-27045d9fabe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:07:27.282977 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620beb-875e-4159-9a07-27045d9fabe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:07:27.284611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-54620beb-875e-4159-9a07-27045d9fabe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:07:27.294291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:27.401153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54620beb-875e-4159-9a07-27045d9fabe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:07:27.402585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54620beb-875e-4159-9a07-27045d9fabe5 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:07:27.421665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 589/1170] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:07:36.796953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=82 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:37.418625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=50 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:46.865942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc074a-45bb-4a77-b7e0-d30e2133b5aa None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:46.867112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc074a-45bb-4a77-b7e0-d30e2133b5aa None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:46.867112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc074a-45bb-4a77-b7e0-d30e2133b5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:46.952035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2dcc074a-45bb-4a77-b7e0-d30e2133b5aa None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:46.953306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2dcc074a-45bb-4a77-b7e0-d30e2133b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:47.054058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 582/1171] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:08:47.062255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b97d-b872-4835-8c88-0a369e8b5075 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:47.062763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b97d-b872-4835-8c88-0a369e8b5075 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:47.062763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b97d-b872-4835-8c88-0a369e8b5075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:47.141759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4075b97d-b872-4835-8c88-0a369e8b5075 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:47.142879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4075b97d-b872-4835-8c88-0a369e8b5075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:47.247461 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 590/1172] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:08:47.252317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc074a-45bb-4a77-b7e0-d30e2133b5aa None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:47.256207 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2dcc074a-45bb-4a77-b7e0-d30e2133b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:47.265838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc074a-45bb-4a77-b7e0-d30e2133b5aa None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:47.331324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:47.368205 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:47.368850 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:47.369129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:47.369423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:47.370058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:08:47.370357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:47.371419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING py.warnings [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:08:47.371419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: warnings.warn(msg) Oct 24 13:08:47.371419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: Oct 24 13:08:47.372340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:47.384533 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 583/1173] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:08:47.394888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075b97d-b872-4835-8c88-0a369e8b5075 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:47.407216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075b97d-b872-4835-8c88-0a369e8b5075 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:47.481399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:47.517379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbb3b6-995b-4662-9a5e-5e6ba6aacc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:47.517993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbb3b6-995b-4662-9a5e-5e6ba6aacc25 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:47.518270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbb3b6-995b-4662-9a5e-5e6ba6aacc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:47.518535 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbb3b6-995b-4662-9a5e-5e6ba6aacc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:47.519165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbb3b6-995b-4662-9a5e-5e6ba6aacc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:47.520275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WARNING py.warnings [None req-d9fbb3b6-995b-4662-9a5e-5e6ba6aacc25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:08:47.520275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: warnings.warn(msg) Oct 24 13:08:47.520275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: Oct 24 13:08:47.521493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbb3b6-995b-4662-9a5e-5e6ba6aacc25 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:47.578309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 591/1174] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:08:47 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:08:47.582718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:47.584242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:47.618940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057d415-0ab4-4bf0-adb6-fb79d9135f39 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:47.712020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555f9a8-7837-41ce-bc17-26f0d608801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:47.712570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555f9a8-7837-41ce-bc17-26f0d608801c admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:47.712841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555f9a8-7837-41ce-bc17-26f0d608801c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:47.713113 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555f9a8-7837-41ce-bc17-26f0d608801c admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:47.713743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555f9a8-7837-41ce-bc17-26f0d608801c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:47.714782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING py.warnings [None req-4555f9a8-7837-41ce-bc17-26f0d608801c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:08:47.714782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: warnings.warn(msg) Oct 24 13:08:47.714782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: Oct 24 13:08:47.715997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555f9a8-7837-41ce-bc17-26f0d608801c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:47.769850 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 584/1175] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:08:47 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:08:47.775306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbb3b6-995b-4662-9a5e-5e6ba6aacc25 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:47.776860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d9fbb3b6-995b-4662-9a5e-5e6ba6aacc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:47.844002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbb3b6-995b-4662-9a5e-5e6ba6aacc25 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:47.931998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:47.943115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d668-bc00-458f-b6e4-18ac1a7cdaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:47.943729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d668-bc00-458f-b6e4-18ac1a7cdaef admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:47.944004 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d668-bc00-458f-b6e4-18ac1a7cdaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:47.944274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d668-bc00-458f-b6e4-18ac1a7cdaef admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:47.944952 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5d668-bc00-458f-b6e4-18ac1a7cdaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:47.946564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5d668-bc00-458f-b6e4-18ac1a7cdaef admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:47.958869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 592/1176] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:08:47.963134 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555f9a8-7837-41ce-bc17-26f0d608801c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:47.964641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4555f9a8-7837-41ce-bc17-26f0d608801c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:47.976554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555f9a8-7837-41ce-bc17-26f0d608801c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:48.003456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:48.090706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd38589-c64c-413b-bab3-97c01f07c979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:48.091310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38589-c64c-413b-bab3-97c01f07c979 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:48.091581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38589-c64c-413b-bab3-97c01f07c979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:48.091849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38589-c64c-413b-bab3-97c01f07c979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:48.092529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38589-c64c-413b-bab3-97c01f07c979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:48.094141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38589-c64c-413b-bab3-97c01f07c979 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:48.107135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 585/1177] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:08:48.111648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d668-bc00-458f-b6e4-18ac1a7cdaef admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:48.113230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-40d5d668-bc00-458f-b6e4-18ac1a7cdaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:48.148659 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d668-bc00-458f-b6e4-18ac1a7cdaef admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:48.245182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d339da-39bd-4aba-a617-af7041f83648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:48.245791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d339da-39bd-4aba-a617-af7041f83648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:48.246099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d339da-39bd-4aba-a617-af7041f83648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:48.246421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d339da-39bd-4aba-a617-af7041f83648 admin admin] PATH_INFO: `/v3/projects/c59a8ac0e9e84d97b19605b8da1a29ff/users/18d3b356ca314930b9cdad00389738ac/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:48.270420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d339da-39bd-4aba-a617-af7041f83648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59a8ac0e9e84d97b19605b8da1a29ff, user_id=18d3b356ca314930b9cdad00389738ac, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:48.273236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d339da-39bd-4aba-a617-af7041f83648 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:48.303026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 593/1178] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:08:48 2022] PUT /identity/v3/projects/c59a8ac0e9e84d97b19605b8da1a29ff/users/18d3b356ca314930b9cdad00389738ac/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:08:48.314640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0bb7e-8062-4d98-9d3f-01689be13350 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:48.314924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0bb7e-8062-4d98-9d3f-01689be13350 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:48.315219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0bb7e-8062-4d98-9d3f-01689be13350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:48.386459 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-94a0bb7e-8062-4d98-9d3f-01689be13350 None None] MFA Rules not processed for user `18d3b356ca314930b9cdad00389738ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:48.387725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-94a0bb7e-8062-4d98-9d3f-01689be13350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:48.469662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 586/1179] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:08:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:08:48.483715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa6a4-4fb9-4c5f-b340-e2c0b2eb6853 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:48.483996 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa6a4-4fb9-4c5f-b340-e2c0b2eb6853 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:48.484267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaa6a4-4fb9-4c5f-b340-e2c0b2eb6853 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:48.485669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 594/1180] 10.222.0.15 () {54 vars in 963 bytes} [Mon Oct 24 13:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:08:48.490686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00965b5-a880-4abd-952c-e79e13f46340 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:48.490963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00965b5-a880-4abd-952c-e79e13f46340 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:48.491231 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00965b5-a880-4abd-952c-e79e13f46340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:48.526372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:48.578074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a00965b5-a880-4abd-952c-e79e13f46340 None None] MFA Rules not processed for user `c9b6f4afedfc4d45995b8a671e2d01e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:48.579295 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a00965b5-a880-4abd-952c-e79e13f46340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:48.659313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 587/1181] 10.222.0.15 () {58 vars in 1060 bytes} [Mon Oct 24 13:08:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:08:48.667150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaa6a4-4fb9-4c5f-b340-e2c0b2eb6853 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:48.668877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-dfeaa6a4-4fb9-4c5f-b340-e2c0b2eb6853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:48.724451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:48.785546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaa6a4-4fb9-4c5f-b340-e2c0b2eb6853 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:48.869735 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368c26-0c4b-4564-821d-14d01714586c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:48.870341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368c26-0c4b-4564-821d-14d01714586c service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:48.870617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368c26-0c4b-4564-821d-14d01714586c service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:48.870879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368c26-0c4b-4564-821d-14d01714586c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:48.872560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8a368c26-0c4b-4564-821d-14d01714586c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:48.973811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a368c26-0c4b-4564-821d-14d01714586c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:48.975261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a368c26-0c4b-4564-821d-14d01714586c service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:48.978685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:48.994464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 595/1182] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:08:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:08:49.041087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136efed-7506-4d8b-8a66-51df8235fbae None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:49.041549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136efed-7506-4d8b-8a66-51df8235fbae None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:49.041658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136efed-7506-4d8b-8a66-51df8235fbae None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:49.042886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 588/1183] 10.222.0.15 () {52 vars in 830 bytes} [Mon Oct 24 13:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:08:49.046787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368c26-0c4b-4564-821d-14d01714586c service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:49.048010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8a368c26-0c4b-4564-821d-14d01714586c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:49.154404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368c26-0c4b-4564-821d-14d01714586c service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:49.260686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:49.261313 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:49.261614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:49.261984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] PATH_INFO: `/v3/users/18d3b356ca314930b9cdad00389738ac` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:49.276561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d3b356ca314930b9cdad00389738ac)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:49.277609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WARNING py.warnings [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:08:49.277609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: warnings.warn(msg) Oct 24 13:08:49.277609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: Oct 24 13:08:49.278829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:49.288416 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:49.349560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d3b356ca314930b9cdad00389738ac'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:08:49.364705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d3b356ca314930b9cdad00389738ac'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:08:49.365162 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d3b356ca314930b9cdad00389738ac'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:08:49.390370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d3b356ca314930b9cdad00389738ac'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:08:49.390938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d3b356ca314930b9cdad00389738ac'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:08:49.409140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 596/1184] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:08:49 2022] DELETE /identity/v3/users/18d3b356ca314930b9cdad00389738ac => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:08:49.414809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb0105-ce2c-4e8a-8ae9-62499b92be86 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:49.415143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb0105-ce2c-4e8a-8ae9-62499b92be86 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:49.415453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb0105-ce2c-4e8a-8ae9-62499b92be86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:49.476273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-0ecb0105-ce2c-4e8a-8ae9-62499b92be86 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:08:49.477509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0ecb0105-ce2c-4e8a-8ae9-62499b92be86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:49.558567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:49.570968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 589/1185] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:08:49.581291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:49.582520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:49.688848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1dd41-4fbd-45b3-979f-d72401b9d6ab admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:49.747925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:08:49.769147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8c3e6-c26f-430b-b399-230ffd2a7211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:49.769765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c3e6-c26f-430b-b399-230ffd2a7211 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:49.770038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c3e6-c26f-430b-b399-230ffd2a7211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:49.770308 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c3e6-c26f-430b-b399-230ffd2a7211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:49.771891 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ebb8c3e6-c26f-430b-b399-230ffd2a7211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:49.887820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8c3e6-c26f-430b-b399-230ffd2a7211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:49.889298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8c3e6-c26f-430b-b399-230ffd2a7211 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:49.907803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 597/1186] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:08:50.251660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb0105-ce2c-4e8a-8ae9-62499b92be86 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:08:50.252969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0ecb0105-ce2c-4e8a-8ae9-62499b92be86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:08:50.264852 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb0105-ce2c-4e8a-8ae9-62499b92be86 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:08:50.363477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:08:50.364114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:08:50.364416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:08:50.364681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] PATH_INFO: `/v3/projects/c59a8ac0e9e84d97b19605b8da1a29ff` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:08:50.377000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59a8ac0e9e84d97b19605b8da1a29ff)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:08:50.378043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING py.warnings [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:08:50.378043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: warnings.warn(msg) Oct 24 13:08:50.378043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: Oct 24 13:08:50.379220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:08:50.443656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59a8ac0e9e84d97b19605b8da1a29ff', 'request_id': 'req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:08:50.455001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59a8ac0e9e84d97b19605b8da1a29ff', 'request_id': 'req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:08:50.469820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59a8ac0e9e84d97b19605b8da1a29ff', 'request_id': 'req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:08:50.493711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] The token cache is being invalidate because project c59a8ac0e9e84d97b19605b8da1a29ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:08:50.494000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:08:50.494519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30d98bf3-d007-4ba5-aa1b-526bfb40ebcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:08:50.495871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 590/1187] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:08:50 2022] DELETE /identity/v3/projects/c59a8ac0e9e84d97b19605b8da1a29ff => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:08:59.905468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=62 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:09:00.491140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:10:26.397951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ec8ef-54af-4f2c-bd2a-4ccc3f2308dc None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:26.398600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ec8ef-54af-4f2c-bd2a-4ccc3f2308dc None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:26.398600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ec8ef-54af-4f2c-bd2a-4ccc3f2308dc None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:26.399860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 598/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:10:26.405603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e0cc-4c08-45aa-93fa-fca6a04cab40 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:26.406075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e0cc-4c08-45aa-93fa-fca6a04cab40 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:26.406173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e0cc-4c08-45aa-93fa-fca6a04cab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:26.493489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c221e0cc-4c08-45aa-93fa-fca6a04cab40 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:10:26.494695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c221e0cc-4c08-45aa-93fa-fca6a04cab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:26.603428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 591/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:10:26.771388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ec8ef-54af-4f2c-bd2a-4ccc3f2308dc None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:10:26.774188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c79ec8ef-54af-4f2c-bd2a-4ccc3f2308dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:26.907396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ec8ef-54af-4f2c-bd2a-4ccc3f2308dc None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:10:26.913542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b8e95-f9f8-419a-ab66-36d8d11430ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:10:26.914150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b8e95-f9f8-419a-ab66-36d8d11430ec service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:26.914430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b8e95-f9f8-419a-ab66-36d8d11430ec service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:26.914709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b8e95-f9f8-419a-ab66-36d8d11430ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:26.923011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b8e95-f9f8-419a-ab66-36d8d11430ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:10:26.924658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b8e95-f9f8-419a-ab66-36d8d11430ec service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:10:26.942792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 599/1190] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:10:28.012699 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d41e70-38a3-44c9-bc7b-0ef35f0fb963 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:28.013321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d41e70-38a3-44c9-bc7b-0ef35f0fb963 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:28.013321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d41e70-38a3-44c9-bc7b-0ef35f0fb963 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:28.014616 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 592/1191] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:10:28.020558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91957a03-2484-41d5-b9e2-954d1d59da4a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:28.021270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91957a03-2484-41d5-b9e2-954d1d59da4a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:28.021428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91957a03-2484-41d5-b9e2-954d1d59da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:28.049044 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-91957a03-2484-41d5-b9e2-954d1d59da4a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:10:28.050289 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-91957a03-2484-41d5-b9e2-954d1d59da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:28.059297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 600/1192] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:10:28.122423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac11b4-5c94-4e13-a7bf-6a150ea42f45 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:28.122813 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac11b4-5c94-4e13-a7bf-6a150ea42f45 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:28.123151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac11b4-5c94-4e13-a7bf-6a150ea42f45 None None] PATH_INFO: `/v3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:28.124636 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 593/1193] 10.222.0.13 () {54 vars in 925 bytes} [Mon Oct 24 13:10:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:10:28.146745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fafd9e-7436-47d2-8d74-33efedd67a1a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:28.147030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fafd9e-7436-47d2-8d74-33efedd67a1a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:28.147294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fafd9e-7436-47d2-8d74-33efedd67a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:28.209762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a6fafd9e-7436-47d2-8d74-33efedd67a1a None None] MFA Rules not processed for user `3a25b60f83d84fb38a759d6620c1c58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:10:28.210418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac11b4-5c94-4e13-a7bf-6a150ea42f45 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:10:28.210925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a6fafd9e-7436-47d2-8d74-33efedd67a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:28.225949 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac11b4-5c94-4e13-a7bf-6a150ea42f45 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:10:28.231905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b483c6-9788-4137-b5dc-2436b79f441c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:10:28.232542 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b483c6-9788-4137-b5dc-2436b79f441c service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:28.232824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b483c6-9788-4137-b5dc-2436b79f441c service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:28.233098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b483c6-9788-4137-b5dc-2436b79f441c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:28.241351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b483c6-9788-4137-b5dc-2436b79f441c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:10:28.243394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b483c6-9788-4137-b5dc-2436b79f441c service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:10:28.253038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 594/1194] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:10:28.264990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:10:28.284916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 601/1195] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Oct 24 13:10:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:10:31.883174 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7572fe-05e2-4889-87a6-8af7b83992bf None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:31.883726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7572fe-05e2-4889-87a6-8af7b83992bf None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:31.883841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7572fe-05e2-4889-87a6-8af7b83992bf None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:31.885224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 595/1196] 10.222.0.15 () {54 vars in 961 bytes} [Mon Oct 24 13:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:10:31.890306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1dcd0-44bd-42f1-b0ab-62e66b1574f8 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:31.890762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1dcd0-44bd-42f1-b0ab-62e66b1574f8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:31.890915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1dcd0-44bd-42f1-b0ab-62e66b1574f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:31.911310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-51f1dcd0-44bd-42f1-b0ab-62e66b1574f8 None None] MFA Rules not processed for user `3a25b60f83d84fb38a759d6620c1c58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:10:31.912631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-51f1dcd0-44bd-42f1-b0ab-62e66b1574f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:31.922899 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 602/1197] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Oct 24 13:10:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:10:31.930954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7572fe-05e2-4889-87a6-8af7b83992bf None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:10:31.947024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7572fe-05e2-4889-87a6-8af7b83992bf None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:10:31.952503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e1029-2ac7-4dee-81df-0cfe4624c745 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:10:31.953122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1029-2ac7-4dee-81df-0cfe4624c745 service placement] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:31.953422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1029-2ac7-4dee-81df-0cfe4624c745 service placement] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:31.953689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1029-2ac7-4dee-81df-0cfe4624c745 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:31.962168 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e1029-2ac7-4dee-81df-0cfe4624c745 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:10:31.963761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e1029-2ac7-4dee-81df-0cfe4624c745 service placement] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:10:31.973272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 596/1198] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:10:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:10:39.735928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f30df4-0432-4252-9e61-dd2bac0ffa03 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:39.736587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f30df4-0432-4252-9e61-dd2bac0ffa03 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:39.736587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f30df4-0432-4252-9e61-dd2bac0ffa03 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:39.738003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 603/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:10:39.744356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97baa2-bcba-4ae3-99ea-abc0e4245259 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:39.745096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97baa2-bcba-4ae3-99ea-abc0e4245259 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:39.745254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97baa2-bcba-4ae3-99ea-abc0e4245259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:39.766964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-da97baa2-bcba-4ae3-99ea-abc0e4245259 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:10:39.768178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-da97baa2-bcba-4ae3-99ea-abc0e4245259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:39.776943 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 597/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:10:39.935082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f30df4-0432-4252-9e61-dd2bac0ffa03 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:10:39.956661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f30df4-0432-4252-9e61-dd2bac0ffa03 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:10:39.962877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8793466-cfd9-412b-960f-040c724d4daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:10:39.963476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8793466-cfd9-412b-960f-040c724d4daa service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:39.963750 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8793466-cfd9-412b-960f-040c724d4daa service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:39.964021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8793466-cfd9-412b-960f-040c724d4daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:39.972007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8793466-cfd9-412b-960f-040c724d4daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:10:39.973627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8793466-cfd9-412b-960f-040c724d4daa service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:10:39.982895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 604/1201] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:10:41.036051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b974a8-1dcc-4e82-946c-ba35e89076f0 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:41.036944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b974a8-1dcc-4e82-946c-ba35e89076f0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:41.036944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b974a8-1dcc-4e82-946c-ba35e89076f0 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:41.039260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 598/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 13:10:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:10:41.045538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7327a2-df22-4bc2-ab0f-a56b38d8155c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:41.046008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7327a2-df22-4bc2-ab0f-a56b38d8155c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:41.046124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7327a2-df22-4bc2-ab0f-a56b38d8155c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:41.071158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ae7327a2-df22-4bc2-ab0f-a56b38d8155c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:10:41.072405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ae7327a2-df22-4bc2-ab0f-a56b38d8155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:41.081169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 605/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 13:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:10:41.230178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b974a8-1dcc-4e82-946c-ba35e89076f0 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:10:41.251609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b974a8-1dcc-4e82-946c-ba35e89076f0 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:10:41.258652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1590dc0-c81d-4580-8de7-79f1fd1771bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:10:41.259266 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1590dc0-c81d-4580-8de7-79f1fd1771bd service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:41.259547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1590dc0-c81d-4580-8de7-79f1fd1771bd service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:41.259814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1590dc0-c81d-4580-8de7-79f1fd1771bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:41.268920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1590dc0-c81d-4580-8de7-79f1fd1771bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:10:41.270516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1590dc0-c81d-4580-8de7-79f1fd1771bd service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:10:41.280358 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 599/1204] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:10:45.584037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dc5aa-bbb6-4c7f-af13-a8e58877883d None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:45.585154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dc5aa-bbb6-4c7f-af13-a8e58877883d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:45.585154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dc5aa-bbb6-4c7f-af13-a8e58877883d None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:45.587134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 606/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:10:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:10:45.592700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de7b5-179b-497a-b214-8bc9230deb98 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:45.593160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de7b5-179b-497a-b214-8bc9230deb98 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:45.593266 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de7b5-179b-497a-b214-8bc9230deb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:45.613741 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d19de7b5-179b-497a-b214-8bc9230deb98 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:10:45.614964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d19de7b5-179b-497a-b214-8bc9230deb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:45.624031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 600/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:10:45.909543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dc5aa-bbb6-4c7f-af13-a8e58877883d None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:10:45.912776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e99dc5aa-bbb6-4c7f-af13-a8e58877883d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:46.008493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dc5aa-bbb6-4c7f-af13-a8e58877883d None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:10:46.013198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cba445-4891-4160-a37a-00b18d0f2d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:10:46.013814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cba445-4891-4160-a37a-00b18d0f2d62 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:46.014094 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cba445-4891-4160-a37a-00b18d0f2d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:46.014367 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cba445-4891-4160-a37a-00b18d0f2d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:46.023852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cba445-4891-4160-a37a-00b18d0f2d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:10:46.025346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cba445-4891-4160-a37a-00b18d0f2d62 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:10:46.034778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 607/1207] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:10:48.166126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe86b-5156-431a-a185-793697eb6cec None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:48.166972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe86b-5156-431a-a185-793697eb6cec None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:48.166972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe86b-5156-431a-a185-793697eb6cec None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:48.168424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 601/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:10:48.176077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a78a7-114f-41ea-a61d-d21ee5c91ee1 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:48.176537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a78a7-114f-41ea-a61d-d21ee5c91ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:48.176638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a78a7-114f-41ea-a61d-d21ee5c91ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:48.203623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-db6a78a7-114f-41ea-a61d-d21ee5c91ee1 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:10:48.204988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-db6a78a7-114f-41ea-a61d-d21ee5c91ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:48.214451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 608/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:10:48.504903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efe86b-5156-431a-a185-793697eb6cec None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:10:48.524666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efe86b-5156-431a-a185-793697eb6cec None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:10:48.529871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6600fc-7bc1-4ca5-b395-2f23c3706e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:10:48.530471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6600fc-7bc1-4ca5-b395-2f23c3706e2f service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:48.530748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6600fc-7bc1-4ca5-b395-2f23c3706e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:48.531016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6600fc-7bc1-4ca5-b395-2f23c3706e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:48.541088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6600fc-7bc1-4ca5-b395-2f23c3706e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:10:48.542519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6600fc-7bc1-4ca5-b395-2f23c3706e2f service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:10:48.552211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 602/1210] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:10:52.694588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8c37e-4989-4a1e-a4f3-b7bb2b56a374 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:52.695195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8c37e-4989-4a1e-a4f3-b7bb2b56a374 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:52.695195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8c37e-4989-4a1e-a4f3-b7bb2b56a374 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:52.696572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 609/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:10:52.702955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8659e9f-6614-434f-b9a4-4e97d7b6cd54 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:52.703512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8659e9f-6614-434f-b9a4-4e97d7b6cd54 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:52.703512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8659e9f-6614-434f-b9a4-4e97d7b6cd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:52.716995 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:10:52.735650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b8659e9f-6614-434f-b9a4-4e97d7b6cd54 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:10:52.736884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b8659e9f-6614-434f-b9a4-4e97d7b6cd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:52.746371 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 603/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:10:53.049642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8c37e-4989-4a1e-a4f3-b7bb2b56a374 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:10:53.051748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-66e8c37e-4989-4a1e-a4f3-b7bb2b56a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:53.132657 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8c37e-4989-4a1e-a4f3-b7bb2b56a374 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:10:53.136615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b0949-a3df-40fb-a058-80f47081e56f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:10:53.137243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b0949-a3df-40fb-a058-80f47081e56f service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:53.137568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b0949-a3df-40fb-a058-80f47081e56f service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:53.137845 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b0949-a3df-40fb-a058-80f47081e56f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:53.151622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b0949-a3df-40fb-a058-80f47081e56f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:10:53.153283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b0949-a3df-40fb-a058-80f47081e56f service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:10:53.163721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 610/1213] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:10:55.321718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89e3e-1a89-4939-b243-f3c16ad6561a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:55.322323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89e3e-1a89-4939-b243-f3c16ad6561a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:55.322323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89e3e-1a89-4939-b243-f3c16ad6561a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:55.323673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 604/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 13:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:10:55.329340 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92edbf-c875-454e-a680-21218357396f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:55.329826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92edbf-c875-454e-a680-21218357396f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:55.329922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92edbf-c875-454e-a680-21218357396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:55.351706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-2c92edbf-c875-454e-a680-21218357396f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:10:55.352965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2c92edbf-c875-454e-a680-21218357396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:55.362222 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 611/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 13:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:10:55.663920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a89e3e-1a89-4939-b243-f3c16ad6561a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:10:55.666291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d6a89e3e-1a89-4939-b243-f3c16ad6561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:10:55.681637 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a89e3e-1a89-4939-b243-f3c16ad6561a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:10:55.685554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd889e-042c-4181-b067-620444f7beaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:10:55.686153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd889e-042c-4181-b067-620444f7beaf service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:10:55.686426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd889e-042c-4181-b067-620444f7beaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:10:55.686694 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd889e-042c-4181-b067-620444f7beaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:10:55.697549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd889e-042c-4181-b067-620444f7beaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:10:55.698991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd889e-042c-4181-b067-620444f7beaf service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:10:55.708729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 605/1216] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:11:05.346444 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:11:05.704616 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=8 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:26.001968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fc8d6-1c6f-41fc-bd5b-127e6d7bd3ee None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.002645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fc8d6-1c6f-41fc-bd5b-127e6d7bd3ee None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.002645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fc8d6-1c6f-41fc-bd5b-127e6d7bd3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.026230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a35fc8d6-1c6f-41fc-bd5b-127e6d7bd3ee None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.027473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a35fc8d6-1c6f-41fc-bd5b-127e6d7bd3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.047278 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 612/1217] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.056024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27a859-47cf-4806-91fd-44b3b8ef4d0d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.056663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27a859-47cf-4806-91fd-44b3b8ef4d0d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.056663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27a859-47cf-4806-91fd-44b3b8ef4d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.082839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9d27a859-47cf-4806-91fd-44b3b8ef4d0d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.084101 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9d27a859-47cf-4806-91fd-44b3b8ef4d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.093714 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d30c4-bfca-4e79-b649-5a086c498a65 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.094043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d30c4-bfca-4e79-b649-5a086c498a65 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.094290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d30c4-bfca-4e79-b649-5a086c498a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.099478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 606/1218] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.100480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1856db-43e7-41eb-a3ef-06d9cc090cde None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.100763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1856db-43e7-41eb-a3ef-06d9cc090cde None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.101039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1856db-43e7-41eb-a3ef-06d9cc090cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.122078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-cd3d30c4-bfca-4e79-b649-5a086c498a65 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.123315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cd3d30c4-bfca-4e79-b649-5a086c498a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.134111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7e1856db-43e7-41eb-a3ef-06d9cc090cde None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.135314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7e1856db-43e7-41eb-a3ef-06d9cc090cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.138743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 613/1219] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:12:26.139690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d30c4-bfca-4e79-b649-5a086c498a65 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.150024 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d30c4-bfca-4e79-b649-5a086c498a65 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.151927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 607/1220] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.153242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7179f06-bfbc-4a22-b4fa-39dd1b33c8c0 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.153523 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7179f06-bfbc-4a22-b4fa-39dd1b33c8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.153795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7179f06-bfbc-4a22-b4fa-39dd1b33c8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.158919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de3a97-1c64-4c1b-a90d-9da5b4024958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.159550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de3a97-1c64-4c1b-a90d-9da5b4024958 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.159829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de3a97-1c64-4c1b-a90d-9da5b4024958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.160102 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de3a97-1c64-4c1b-a90d-9da5b4024958 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.160799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de3a97-1c64-4c1b-a90d-9da5b4024958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:26.161106 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de3a97-1c64-4c1b-a90d-9da5b4024958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.162133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WARNING py.warnings [None req-17de3a97-1c64-4c1b-a90d-9da5b4024958 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:12:26.162133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: warnings.warn(msg) Oct 24 13:12:26.162133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: Oct 24 13:12:26.163021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de3a97-1c64-4c1b-a90d-9da5b4024958 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.187698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 614/1221] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:26.188821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce14ebd-f67c-4c26-9fcb-8fbba92ce996 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.189108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce14ebd-f67c-4c26-9fcb-8fbba92ce996 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.189383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce14ebd-f67c-4c26-9fcb-8fbba92ce996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.191640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f7179f06-bfbc-4a22-b4fa-39dd1b33c8c0 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.194966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f7179f06-bfbc-4a22-b4fa-39dd1b33c8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.209591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 608/1222] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.211376 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e67e1e-38df-4921-a599-261f89b347fe None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.211875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e67e1e-38df-4921-a599-261f89b347fe None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.212500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e67e1e-38df-4921-a599-261f89b347fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.214203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5ce14ebd-f67c-4c26-9fcb-8fbba92ce996 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.215875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5ce14ebd-f67c-4c26-9fcb-8fbba92ce996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.226868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 615/1223] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.227957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce14ebd-f67c-4c26-9fcb-8fbba92ce996 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.240894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce14ebd-f67c-4c26-9fcb-8fbba92ce996 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.246032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0305a-5d4c-405e-9a7e-8dc3734afec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.246649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0305a-5d4c-405e-9a7e-8dc3734afec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.246928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0305a-5d4c-405e-9a7e-8dc3734afec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.247199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0305a-5d4c-405e-9a7e-8dc3734afec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.247838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0305a-5d4c-405e-9a7e-8dc3734afec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.252321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0305a-5d4c-405e-9a7e-8dc3734afec2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.253518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-15e67e1e-38df-4921-a599-261f89b347fe None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.254971 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-15e67e1e-38df-4921-a599-261f89b347fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.269460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 609/1224] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.271087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f0269-40be-4383-af7b-45eda6997719 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.271589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f0269-40be-4383-af7b-45eda6997719 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.272078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f0269-40be-4383-af7b-45eda6997719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.302279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 616/1225] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/projects => generated 363 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:26.307035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6c2a-fc00-449a-9e85-9398e2202971 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.307608 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6c2a-fc00-449a-9e85-9398e2202971 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.308134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6c2a-fc00-449a-9e85-9398e2202971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.312570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-241f0269-40be-4383-af7b-45eda6997719 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.313786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-241f0269-40be-4383-af7b-45eda6997719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.328801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b9ca6c2a-fc00-449a-9e85-9398e2202971 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.330160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b9ca6c2a-fc00-449a-9e85-9398e2202971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.371876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 610/1226] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.372707 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f0269-40be-4383-af7b-45eda6997719 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.381961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f0269-40be-4383-af7b-45eda6997719 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.386513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7edfae-db79-4ff8-840c-70c4beb78b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.387106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7edfae-db79-4ff8-840c-70c4beb78b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.387382 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7edfae-db79-4ff8-840c-70c4beb78b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.387649 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7edfae-db79-4ff8-840c-70c4beb78b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.388344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7edfae-db79-4ff8-840c-70c4beb78b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:26.388644 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7edfae-db79-4ff8-840c-70c4beb78b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.390232 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7edfae-db79-4ff8-840c-70c4beb78b0e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.390708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 617/1227] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.391377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca6c2a-fc00-449a-9e85-9398e2202971 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.400690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca6c2a-fc00-449a-9e85-9398e2202971 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.402023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 611/1228] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:26.403205 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79236915-ae4d-490e-9266-9247a80e1d76 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.403484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79236915-ae4d-490e-9266-9247a80e1d76 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.403755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79236915-ae4d-490e-9266-9247a80e1d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.406026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc4db1-52ba-4ce4-a2dc-499244bf7900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.406688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc4db1-52ba-4ce4-a2dc-499244bf7900 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.406914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc4db1-52ba-4ce4-a2dc-499244bf7900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.407190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc4db1-52ba-4ce4-a2dc-499244bf7900 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.407846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc4db1-52ba-4ce4-a2dc-499244bf7900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:26.408148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc4db1-52ba-4ce4-a2dc-499244bf7900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.409843 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc4db1-52ba-4ce4-a2dc-499244bf7900 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.434220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 618/1229] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:26.434220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc4db1-52ba-4ce4-a2dc-499244bf7900 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.434570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-79236915-ae4d-490e-9266-9247a80e1d76 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.434570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-79236915-ae4d-490e-9266-9247a80e1d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.439715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc4db1-52ba-4ce4-a2dc-499244bf7900 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.440074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 612/1230] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.441301 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa1b5-0339-4e27-991e-499eb2c6662f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.441578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa1b5-0339-4e27-991e-499eb2c6662f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.441843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa1b5-0339-4e27-991e-499eb2c6662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.447423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570ec3d-b0f6-484e-b695-323103f046b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.448035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570ec3d-b0f6-484e-b695-323103f046b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.448345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570ec3d-b0f6-484e-b695-323103f046b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.448770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570ec3d-b0f6-484e-b695-323103f046b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.449413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570ec3d-b0f6-484e-b695-323103f046b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.450428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WARNING py.warnings [None req-b570ec3d-b0f6-484e-b695-323103f046b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:12:26.450428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: warnings.warn(msg) Oct 24 13:12:26.450428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: Oct 24 13:12:26.451635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570ec3d-b0f6-484e-b695-323103f046b5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.462063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3f9fa1b5-0339-4e27-991e-499eb2c6662f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.463265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3f9fa1b5-0339-4e27-991e-499eb2c6662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.472136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 613/1231] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.473558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73da46-89b5-4f54-b7fb-04eba25f196c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.473846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73da46-89b5-4f54-b7fb-04eba25f196c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.474114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73da46-89b5-4f54-b7fb-04eba25f196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.474997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 619/1232] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/users => generated 282 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:26.476080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810c31d-f096-43d2-bba1-32cef1087b88 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.476397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810c31d-f096-43d2-bba1-32cef1087b88 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.476671 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810c31d-f096-43d2-bba1-32cef1087b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.496237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5810c31d-f096-43d2-bba1-32cef1087b88 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.497477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5810c31d-f096-43d2-bba1-32cef1087b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.498804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2d73da46-89b5-4f54-b7fb-04eba25f196c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.499957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2d73da46-89b5-4f54-b7fb-04eba25f196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.505263 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 620/1233] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.506007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810c31d-f096-43d2-bba1-32cef1087b88 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.512232 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 614/1234] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.513062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73da46-89b5-4f54-b7fb-04eba25f196c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.515245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810c31d-f096-43d2-bba1-32cef1087b88 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.522415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73da46-89b5-4f54-b7fb-04eba25f196c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.523967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168ddf2-067c-49cc-9ac7-58a4d2954ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.524762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168ddf2-067c-49cc-9ac7-58a4d2954ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.525020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168ddf2-067c-49cc-9ac7-58a4d2954ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.525291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168ddf2-067c-49cc-9ac7-58a4d2954ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.525976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168ddf2-067c-49cc-9ac7-58a4d2954ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:26.526279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168ddf2-067c-49cc-9ac7-58a4d2954ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.527099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c3061-1b3b-48f7-aecb-a1cf7d57ab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.527733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c3061-1b3b-48f7-aecb-a1cf7d57ab8e admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.527888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168ddf2-067c-49cc-9ac7-58a4d2954ea0 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.528002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c3061-1b3b-48f7-aecb-a1cf7d57ab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.528271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c3061-1b3b-48f7-aecb-a1cf7d57ab8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.528924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c3061-1b3b-48f7-aecb-a1cf7d57ab8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.529932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING py.warnings [None req-4a6c3061-1b3b-48f7-aecb-a1cf7d57ab8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:12:26.529932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: warnings.warn(msg) Oct 24 13:12:26.529932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: Oct 24 13:12:26.531224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c3061-1b3b-48f7-aecb-a1cf7d57ab8e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.547021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 621/1235] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:26.547021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168ddf2-067c-49cc-9ac7-58a4d2954ea0 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.550340 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168ddf2-067c-49cc-9ac7-58a4d2954ea0 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.554901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96257288-8e2e-4e02-8d7e-a53642cbdbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.555489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96257288-8e2e-4e02-8d7e-a53642cbdbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.555823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96257288-8e2e-4e02-8d7e-a53642cbdbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.556048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96257288-8e2e-4e02-8d7e-a53642cbdbe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.556708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96257288-8e2e-4e02-8d7e-a53642cbdbe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.558664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96257288-8e2e-4e02-8d7e-a53642cbdbe1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.567592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 615/1236] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:26.568724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1323e-b5da-4eae-886d-cfa869d2906d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.569006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1323e-b5da-4eae-886d-cfa869d2906d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.569277 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1323e-b5da-4eae-886d-cfa869d2906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.591338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 622/1237] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:26.591338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96257288-8e2e-4e02-8d7e-a53642cbdbe1 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.592594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-55f1323e-b5da-4eae-886d-cfa869d2906d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.594006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-55f1323e-b5da-4eae-886d-cfa869d2906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.615228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:26.651178 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96257288-8e2e-4e02-8d7e-a53642cbdbe1 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.655066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 616/1238] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.655855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b11c0e-3688-41e6-abb8-ff3bd94b313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.656555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b11c0e-3688-41e6-abb8-ff3bd94b313f admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.656711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265918-6b6c-4335-a872-74bbd01933dc None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.656902 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b11c0e-3688-41e6-abb8-ff3bd94b313f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.657004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265918-6b6c-4335-a872-74bbd01933dc None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.657173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b11c0e-3688-41e6-abb8-ff3bd94b313f admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.657270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265918-6b6c-4335-a872-74bbd01933dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.657815 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b11c0e-3688-41e6-abb8-ff3bd94b313f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.659415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b11c0e-3688-41e6-abb8-ff3bd94b313f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.672260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 623/1239] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:26.672260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b11c0e-3688-41e6-abb8-ff3bd94b313f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.678846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-53265918-6b6c-4335-a872-74bbd01933dc None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.679482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b11c0e-3688-41e6-abb8-ff3bd94b313f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.680112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-53265918-6b6c-4335-a872-74bbd01933dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.684567 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041323-912c-4446-86ab-3930f1b0fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.685286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041323-912c-4446-86ab-3930f1b0fd9d admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.685565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041323-912c-4446-86ab-3930f1b0fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.685834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041323-912c-4446-86ab-3930f1b0fd9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.686477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98041323-912c-4446-86ab-3930f1b0fd9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:26.686781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98041323-912c-4446-86ab-3930f1b0fd9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.688155 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 617/1240] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.688530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98041323-912c-4446-86ab-3930f1b0fd9d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.689362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a286c51-c4be-4f25-918d-8740f85dcfd1 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.689640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a286c51-c4be-4f25-918d-8740f85dcfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.689906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a286c51-c4be-4f25-918d-8740f85dcfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.703072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 624/1241] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:26.704048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041323-912c-4446-86ab-3930f1b0fd9d admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.708797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8a286c51-c4be-4f25-918d-8740f85dcfd1 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:26.709971 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8a286c51-c4be-4f25-918d-8740f85dcfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:26.715150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041323-912c-4446-86ab-3930f1b0fd9d admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.717702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 618/1242] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:26.718436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a286c51-c4be-4f25-918d-8740f85dcfd1 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.723223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a49d8-39a8-4ed1-ace2-9789bc9ea609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.723853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a49d8-39a8-4ed1-ace2-9789bc9ea609 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.724113 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a49d8-39a8-4ed1-ace2-9789bc9ea609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.724412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a49d8-39a8-4ed1-ace2-9789bc9ea609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.725072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a49d8-39a8-4ed1-ace2-9789bc9ea609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.727030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a49d8-39a8-4ed1-ace2-9789bc9ea609 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.727931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a286c51-c4be-4f25-918d-8740f85dcfd1 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.732479 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa987452-3027-4b27-b2d8-3fd7a06b061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.733070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa987452-3027-4b27-b2d8-3fd7a06b061f admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.733343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa987452-3027-4b27-b2d8-3fd7a06b061f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.733607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa987452-3027-4b27-b2d8-3fd7a06b061f admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.734229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa987452-3027-4b27-b2d8-3fd7a06b061f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.736160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa987452-3027-4b27-b2d8-3fd7a06b061f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.744988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:26.755994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 625/1243] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:26.757013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a49d8-39a8-4ed1-ace2-9789bc9ea609 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.766297 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 619/1244] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/users => generated 284 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:26.766297 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa987452-3027-4b27-b2d8-3fd7a06b061f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.776520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa987452-3027-4b27-b2d8-3fd7a06b061f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.817347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a49d8-39a8-4ed1-ace2-9789bc9ea609 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.822015 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285bc0a-c15b-46bb-b0fe-f7315937d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.822621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285bc0a-c15b-46bb-b0fe-f7315937d672 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.822898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285bc0a-c15b-46bb-b0fe-f7315937d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.823173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285bc0a-c15b-46bb-b0fe-f7315937d672 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.823802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285bc0a-c15b-46bb-b0fe-f7315937d672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.825811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285bc0a-c15b-46bb-b0fe-f7315937d672 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.832684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe47b0-2a5e-4ac7-8819-c58aca79180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.833304 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe47b0-2a5e-4ac7-8819-c58aca79180a admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.833578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe47b0-2a5e-4ac7-8819-c58aca79180a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.834127 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe47b0-2a5e-4ac7-8819-c58aca79180a admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.834930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe47b0-2a5e-4ac7-8819-c58aca79180a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:26.835233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe47b0-2a5e-4ac7-8819-c58aca79180a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.837028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe47b0-2a5e-4ac7-8819-c58aca79180a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.849431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 626/1245] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:26.850099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285bc0a-c15b-46bb-b0fe-f7315937d672 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.855480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 620/1246] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:26.856440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe47b0-2a5e-4ac7-8819-c58aca79180a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.865556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285bc0a-c15b-46bb-b0fe-f7315937d672 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.866634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe47b0-2a5e-4ac7-8819-c58aca79180a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.871151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dbf15-7725-4a17-8ae3-18b17c74a269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.871765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dbf15-7725-4a17-8ae3-18b17c74a269 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.871879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75796d-3251-4117-9d61-485ec8b67162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.872046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dbf15-7725-4a17-8ae3-18b17c74a269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.872342 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dbf15-7725-4a17-8ae3-18b17c74a269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.872485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75796d-3251-4117-9d61-485ec8b67162 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.872768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75796d-3251-4117-9d61-485ec8b67162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.872998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dbf15-7725-4a17-8ae3-18b17c74a269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.873100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75796d-3251-4117-9d61-485ec8b67162 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.873671 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75796d-3251-4117-9d61-485ec8b67162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:26.873971 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75796d-3251-4117-9d61-485ec8b67162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.874617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dbf15-7725-4a17-8ae3-18b17c74a269 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.875581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75796d-3251-4117-9d61-485ec8b67162 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.888553 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 627/1247] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:26.888553 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dbf15-7725-4a17-8ae3-18b17c74a269 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.888824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 621/1248] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:26.888824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75796d-3251-4117-9d61-485ec8b67162 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.899076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75796d-3251-4117-9d61-485ec8b67162 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.899403 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dbf15-7725-4a17-8ae3-18b17c74a269 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.904053 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c61494-263a-41df-95bf-9b25ebb6d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.904225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f39fea-6eb5-4bf6-9a13-5c60adc8d4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.904585 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c61494-263a-41df-95bf-9b25ebb6d37c admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.904754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f39fea-6eb5-4bf6-9a13-5c60adc8d4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.904852 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c61494-263a-41df-95bf-9b25ebb6d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.905016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f39fea-6eb5-4bf6-9a13-5c60adc8d4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.905121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c61494-263a-41df-95bf-9b25ebb6d37c admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.905314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f39fea-6eb5-4bf6-9a13-5c60adc8d4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.905844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c61494-263a-41df-95bf-9b25ebb6d37c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:26.905950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f39fea-6eb5-4bf6-9a13-5c60adc8d4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.906145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c61494-263a-41df-95bf-9b25ebb6d37c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.907720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c61494-263a-41df-95bf-9b25ebb6d37c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.907823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f39fea-6eb5-4bf6-9a13-5c60adc8d4d5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:26.919280 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 622/1249] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:26.927584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c61494-263a-41df-95bf-9b25ebb6d37c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.936942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c61494-263a-41df-95bf-9b25ebb6d37c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:26.937630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 628/1250] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:26.938369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f39fea-6eb5-4bf6-9a13-5c60adc8d4d5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:26.982891 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:26.995651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f86d2-dbbb-4f4f-85d1-1ab26b6c7547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:26.996275 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f86d2-dbbb-4f4f-85d1-1ab26b6c7547 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:26.996557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f86d2-dbbb-4f4f-85d1-1ab26b6c7547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:26.997210 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f86d2-dbbb-4f4f-85d1-1ab26b6c7547 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:26.997475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f86d2-dbbb-4f4f-85d1-1ab26b6c7547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:26.999393 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f86d2-dbbb-4f4f-85d1-1ab26b6c7547 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.000372 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f39fea-6eb5-4bf6-9a13-5c60adc8d4d5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.005071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa21d5-cf0a-44d4-88c0-26b73d836651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.005696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa21d5-cf0a-44d4-88c0-26b73d836651 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.005944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa21d5-cf0a-44d4-88c0-26b73d836651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.006216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa21d5-cf0a-44d4-88c0-26b73d836651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.006859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa21d5-cf0a-44d4-88c0-26b73d836651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.008676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa21d5-cf0a-44d4-88c0-26b73d836651 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.018880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 629/1251] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.021264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa21d5-cf0a-44d4-88c0-26b73d836651 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.021422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 623/1252] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:26 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:27.022236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f86d2-dbbb-4f4f-85d1-1ab26b6c7547 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.031906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f86d2-dbbb-4f4f-85d1-1ab26b6c7547 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.034046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa21d5-cf0a-44d4-88c0-26b73d836651 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.036399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6d3d9-c4e4-4dfd-b003-32eaedd4e4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.036970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6d3d9-c4e4-4dfd-b003-32eaedd4e4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.037246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6d3d9-c4e4-4dfd-b003-32eaedd4e4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.037513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6d3d9-c4e4-4dfd-b003-32eaedd4e4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.038139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6d3d9-c4e4-4dfd-b003-32eaedd4e4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.039267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca445966-03ce-480e-b22d-3acaff7add3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.039874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca445966-03ce-480e-b22d-3acaff7add3e admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.040054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6d3d9-c4e4-4dfd-b003-32eaedd4e4c2 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.040423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca445966-03ce-480e-b22d-3acaff7add3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.040544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca445966-03ce-480e-b22d-3acaff7add3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.041210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca445966-03ce-480e-b22d-3acaff7add3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.042856 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca445966-03ce-480e-b22d-3acaff7add3e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.052908 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 630/1253] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.053647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca445966-03ce-480e-b22d-3acaff7add3e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.063175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca445966-03ce-480e-b22d-3acaff7add3e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.068022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a32737-c588-4e2a-bd35-ef2d0ff4db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.068773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a32737-c588-4e2a-bd35-ef2d0ff4db6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.069054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a32737-c588-4e2a-bd35-ef2d0ff4db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.069323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a32737-c588-4e2a-bd35-ef2d0ff4db6c admin admin] PATH_INFO: `/v3/projects/b031a0fcd9824a6ca580468f5316f597/users/414595a9ea2e41cf877726950a3a14c0/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.070782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 624/1254] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:27.074756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6d3d9-c4e4-4dfd-b003-32eaedd4e4c2 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.084954 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a32737-c588-4e2a-bd35-ef2d0ff4db6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b031a0fcd9824a6ca580468f5316f597, user_id=414595a9ea2e41cf877726950a3a14c0, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.087627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a32737-c588-4e2a-bd35-ef2d0ff4db6c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.101316 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 631/1255] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:27 2022] PUT /identity/v3/projects/b031a0fcd9824a6ca580468f5316f597/users/414595a9ea2e41cf877726950a3a14c0/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:27.102091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a32737-c588-4e2a-bd35-ef2d0ff4db6c admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.103605 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:27.141747 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6d3d9-c4e4-4dfd-b003-32eaedd4e4c2 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.166106 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a32737-c588-4e2a-bd35-ef2d0ff4db6c admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.170836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3950ffb-6eb5-4f67-b0e5-4c8ed1da5796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.171448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950ffb-6eb5-4f67-b0e5-4c8ed1da5796 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.171789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950ffb-6eb5-4f67-b0e5-4c8ed1da5796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.172033 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950ffb-6eb5-4f67-b0e5-4c8ed1da5796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.172681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3950ffb-6eb5-4f67-b0e5-4c8ed1da5796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.174588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3950ffb-6eb5-4f67-b0e5-4c8ed1da5796 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.198589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b4f7b-a3f8-4bce-85f4-8f75832e0562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.199331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b4f7b-a3f8-4bce-85f4-8f75832e0562 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.199674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b4f7b-a3f8-4bce-85f4-8f75832e0562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.200037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b4f7b-a3f8-4bce-85f4-8f75832e0562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.200702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b4f7b-a3f8-4bce-85f4-8f75832e0562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.201641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 632/1256] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:27.202614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b4f7b-a3f8-4bce-85f4-8f75832e0562 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.205661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3950ffb-6eb5-4f67-b0e5-4c8ed1da5796 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.229876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 625/1257] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:27.231585 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b4f7b-a3f8-4bce-85f4-8f75832e0562 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.265599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3950ffb-6eb5-4f67-b0e5-4c8ed1da5796 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.293215 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b4f7b-a3f8-4bce-85f4-8f75832e0562 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.296683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:27.297738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dd939-b2fd-48eb-a126-aa57eb247fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.298353 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dd939-b2fd-48eb-a126-aa57eb247fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.298638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dd939-b2fd-48eb-a126-aa57eb247fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.298949 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dd939-b2fd-48eb-a126-aa57eb247fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.299564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dd939-b2fd-48eb-a126-aa57eb247fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.301271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dd939-b2fd-48eb-a126-aa57eb247fd0 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.311259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 626/1258] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.312138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dd939-b2fd-48eb-a126-aa57eb247fd0 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.321601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dd939-b2fd-48eb-a126-aa57eb247fd0 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.322495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9e56-1fb2-49cf-b07f-f7975f975439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.323126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9e56-1fb2-49cf-b07f-f7975f975439 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.323404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9e56-1fb2-49cf-b07f-f7975f975439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.323704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9e56-1fb2-49cf-b07f-f7975f975439 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.324380 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9e56-1fb2-49cf-b07f-f7975f975439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.326127 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705c816-c16d-47b2-9ba2-3a252ff68c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.326702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705c816-c16d-47b2-9ba2-3a252ff68c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.326949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9e56-1fb2-49cf-b07f-f7975f975439 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.327066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705c816-c16d-47b2-9ba2-3a252ff68c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.327238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705c816-c16d-47b2-9ba2-3a252ff68c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.327863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705c816-c16d-47b2-9ba2-3a252ff68c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.329465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705c816-c16d-47b2-9ba2-3a252ff68c41 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.339863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 627/1259] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.340793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705c816-c16d-47b2-9ba2-3a252ff68c41 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.350462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705c816-c16d-47b2-9ba2-3a252ff68c41 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.354410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 633/1260] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:27.354410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9e56-1fb2-49cf-b07f-f7975f975439 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.355762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c1ea3-ff17-46dc-be4a-2fe3b30d76e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.356392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c1ea3-ff17-46dc-be4a-2fe3b30d76e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.356674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c1ea3-ff17-46dc-be4a-2fe3b30d76e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.356945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c1ea3-ff17-46dc-be4a-2fe3b30d76e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.357720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c1ea3-ff17-46dc-be4a-2fe3b30d76e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.359391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c1ea3-ff17-46dc-be4a-2fe3b30d76e7 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.362835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9e56-1fb2-49cf-b07f-f7975f975439 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.370025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3656b1-7b80-4ed4-a2c4-dc7e5ebea936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.370418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 628/1261] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.370641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3656b1-7b80-4ed4-a2c4-dc7e5ebea936 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.370915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3656b1-7b80-4ed4-a2c4-dc7e5ebea936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.371181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3656b1-7b80-4ed4-a2c4-dc7e5ebea936 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.371807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538adcf-a90d-48b5-afb0-d590775347ee None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.371905 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3656b1-7b80-4ed4-a2c4-dc7e5ebea936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.372094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538adcf-a90d-48b5-afb0-d590775347ee None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.372395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538adcf-a90d-48b5-afb0-d590775347ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.373857 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3656b1-7b80-4ed4-a2c4-dc7e5ebea936 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.395898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 634/1262] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:27.397011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3656b1-7b80-4ed4-a2c4-dc7e5ebea936 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.402235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e538adcf-a90d-48b5-afb0-d590775347ee None None] MFA Rules not processed for user `414595a9ea2e41cf877726950a3a14c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:27.403450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e538adcf-a90d-48b5-afb0-d590775347ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:27.406460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3656b1-7b80-4ed4-a2c4-dc7e5ebea936 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.412265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8dd19-f5d6-4f20-951b-fdbbd04c156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.412904 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8dd19-f5d6-4f20-951b-fdbbd04c156d admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.413182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8dd19-f5d6-4f20-951b-fdbbd04c156d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.413449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8dd19-f5d6-4f20-951b-fdbbd04c156d admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.414123 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8dd19-f5d6-4f20-951b-fdbbd04c156d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.416177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8dd19-f5d6-4f20-951b-fdbbd04c156d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.422379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:27.442966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 635/1263] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:27.442966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8dd19-f5d6-4f20-951b-fdbbd04c156d admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.450154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8dd19-f5d6-4f20-951b-fdbbd04c156d admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.454630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f23b6-04ef-4343-8ae4-2575ee402ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.455220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f23b6-04ef-4343-8ae4-2575ee402ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.455496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f23b6-04ef-4343-8ae4-2575ee402ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.455767 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f23b6-04ef-4343-8ae4-2575ee402ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.456411 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f23b6-04ef-4343-8ae4-2575ee402ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.458301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f23b6-04ef-4343-8ae4-2575ee402ad6 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.473381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 629/1264] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:27.474288 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538adcf-a90d-48b5-afb0-d590775347ee None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.480666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 636/1265] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:27.481385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f23b6-04ef-4343-8ae4-2575ee402ad6 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.485264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538adcf-a90d-48b5-afb0-d590775347ee None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.490133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c33f3-6814-44dd-b7b7-86f3091dea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.490799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c33f3-6814-44dd-b7b7-86f3091dea9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.491059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c33f3-6814-44dd-b7b7-86f3091dea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.491174 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f23b6-04ef-4343-8ae4-2575ee402ad6 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.491333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c33f3-6814-44dd-b7b7-86f3091dea9d admin admin] PATH_INFO: `/v3/projects/5f59afaf69aa444ea2b73b5b03c1f11a/users/c9a931949bd1466e8e2d5ae0f0226d31/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.496364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26446-79fb-4bc3-9893-27f0e9daca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.497005 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26446-79fb-4bc3-9893-27f0e9daca7b admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.497279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26446-79fb-4bc3-9893-27f0e9daca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.497542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26446-79fb-4bc3-9893-27f0e9daca7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.498178 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e26446-79fb-4bc3-9893-27f0e9daca7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.499757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e26446-79fb-4bc3-9893-27f0e9daca7b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.506640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c33f3-6814-44dd-b7b7-86f3091dea9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f59afaf69aa444ea2b73b5b03c1f11a, user_id=c9a931949bd1466e8e2d5ae0f0226d31, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.509401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c33f3-6814-44dd-b7b7-86f3091dea9d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.510161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 637/1266] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.510938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26446-79fb-4bc3-9893-27f0e9daca7b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.520855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26446-79fb-4bc3-9893-27f0e9daca7b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.525812 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 630/1267] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:27 2022] PUT /identity/v3/projects/5f59afaf69aa444ea2b73b5b03c1f11a/users/c9a931949bd1466e8e2d5ae0f0226d31/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:27.526593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c33f3-6814-44dd-b7b7-86f3091dea9d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.586338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1080a-53be-45fe-a795-ae9d43fe9eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.587064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1080a-53be-45fe-a795-ae9d43fe9eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.587278 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1080a-53be-45fe-a795-ae9d43fe9eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.587548 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1080a-53be-45fe-a795-ae9d43fe9eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.588003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c33f3-6814-44dd-b7b7-86f3091dea9d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.588191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1080a-53be-45fe-a795-ae9d43fe9eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.589816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1080a-53be-45fe-a795-ae9d43fe9eaa admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.592714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9084-9679-476f-9466-3e04f349be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.593367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9084-9679-476f-9466-3e04f349be95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.593642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9084-9679-476f-9466-3e04f349be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.593914 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9084-9679-476f-9466-3e04f349be95 admin admin] PATH_INFO: `/v3/projects/b1aaed987ac54150b152e95d0d8e1e3f/users/169da6fc9b04431a9fcf7580c65ab1a3/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.599505 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 638/1268] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.600422 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1080a-53be-45fe-a795-ae9d43fe9eaa admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.610048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1080a-53be-45fe-a795-ae9d43fe9eaa admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.611110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f9084-9679-476f-9466-3e04f349be95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1aaed987ac54150b152e95d0d8e1e3f, user_id=169da6fc9b04431a9fcf7580c65ab1a3, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.613850 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f9084-9679-476f-9466-3e04f349be95 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.614807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16be15-ceee-4097-bfb5-87f8bd2bb72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.615441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16be15-ceee-4097-bfb5-87f8bd2bb72b admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.615724 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16be15-ceee-4097-bfb5-87f8bd2bb72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.615995 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16be15-ceee-4097-bfb5-87f8bd2bb72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.616666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16be15-ceee-4097-bfb5-87f8bd2bb72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.618746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16be15-ceee-4097-bfb5-87f8bd2bb72b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.628066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 631/1269] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:27 2022] PUT /identity/v3/projects/b1aaed987ac54150b152e95d0d8e1e3f/users/169da6fc9b04431a9fcf7580c65ab1a3/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:27.628930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9084-9679-476f-9466-3e04f349be95 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.630692 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 639/1270] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.632072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16be15-ceee-4097-bfb5-87f8bd2bb72b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.641836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16be15-ceee-4097-bfb5-87f8bd2bb72b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.685364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:27.692488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9084-9679-476f-9466-3e04f349be95 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.697357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b40d89-c052-4efa-ae94-b5ff67b1e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.697965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b40d89-c052-4efa-ae94-b5ff67b1e862 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.698144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c38c-e6e9-4f7c-970d-f39f0864a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.698255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b40d89-c052-4efa-ae94-b5ff67b1e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.698491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b40d89-c052-4efa-ae94-b5ff67b1e862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.698758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c38c-e6e9-4f7c-970d-f39f0864a1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.699038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c38c-e6e9-4f7c-970d-f39f0864a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.699160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b40d89-c052-4efa-ae94-b5ff67b1e862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.699316 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c38c-e6e9-4f7c-970d-f39f0864a1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.700089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698c38c-e6e9-4f7c-970d-f39f0864a1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.700831 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b40d89-c052-4efa-ae94-b5ff67b1e862 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.702068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698c38c-e6e9-4f7c-970d-f39f0864a1c0 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.710741 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 632/1271] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.711559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b40d89-c052-4efa-ae94-b5ff67b1e862 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.723425 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b40d89-c052-4efa-ae94-b5ff67b1e862 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.730863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062492b-d3d0-4c34-a9f9-d4069e8a9431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.731477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062492b-d3d0-4c34-a9f9-d4069e8a9431 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.731753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062492b-d3d0-4c34-a9f9-d4069e8a9431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.732021 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062492b-d3d0-4c34-a9f9-d4069e8a9431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.732697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062492b-d3d0-4c34-a9f9-d4069e8a9431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.735888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 640/1272] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:27.735888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c38c-e6e9-4f7c-970d-f39f0864a1c0 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.736097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062492b-d3d0-4c34-a9f9-d4069e8a9431 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.745724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 633/1273] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.747109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed7cb6-d686-4323-8e4a-8379d78d854d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.747387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed7cb6-d686-4323-8e4a-8379d78d854d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.747651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed7cb6-d686-4323-8e4a-8379d78d854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.755138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:27.775943 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-70ed7cb6-d686-4323-8e4a-8379d78d854d None None] MFA Rules not processed for user `c9a931949bd1466e8e2d5ae0f0226d31`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:27.777213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-70ed7cb6-d686-4323-8e4a-8379d78d854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:27.796859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c38c-e6e9-4f7c-970d-f39f0864a1c0 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.805289 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ac112-064e-4f45-b4c8-a5c8f690e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.805996 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ac112-064e-4f45-b4c8-a5c8f690e415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.806272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ac112-064e-4f45-b4c8-a5c8f690e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.806539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ac112-064e-4f45-b4c8-a5c8f690e415 admin admin] PATH_INFO: `/v3/projects/307c102be16c4757889a20c68e7b6544/users/0b96ce275ce04db9b46265361e06a483/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.821773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ac112-064e-4f45-b4c8-a5c8f690e415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307c102be16c4757889a20c68e7b6544, user_id=0b96ce275ce04db9b46265361e06a483, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.824657 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ac112-064e-4f45-b4c8-a5c8f690e415 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.838357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 641/1274] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:27 2022] PUT /identity/v3/projects/307c102be16c4757889a20c68e7b6544/users/0b96ce275ce04db9b46265361e06a483/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:27.839249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ac112-064e-4f45-b4c8-a5c8f690e415 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.848879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 634/1275] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:27.854663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548d64-98a7-493b-ad0f-725c1a7e30b6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.854663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548d64-98a7-493b-ad0f-725c1a7e30b6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.854663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548d64-98a7-493b-ad0f-725c1a7e30b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.873669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-96548d64-98a7-493b-ad0f-725c1a7e30b6 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:27.874886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-96548d64-98a7-493b-ad0f-725c1a7e30b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:27.908826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ac112-064e-4f45-b4c8-a5c8f690e415 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.913317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0ea0b-04bf-4b31-a05d-2a6a34f4e88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.913927 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0ea0b-04bf-4b31-a05d-2a6a34f4e88b admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.914200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0ea0b-04bf-4b31-a05d-2a6a34f4e88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.914469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0ea0b-04bf-4b31-a05d-2a6a34f4e88b admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.915169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0ea0b-04bf-4b31-a05d-2a6a34f4e88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.916919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0ea0b-04bf-4b31-a05d-2a6a34f4e88b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.927031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 642/1276] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.927839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0ea0b-04bf-4b31-a05d-2a6a34f4e88b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.936069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 635/1277] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:27.936069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96548d64-98a7-493b-ad0f-725c1a7e30b6 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.937763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0ea0b-04bf-4b31-a05d-2a6a34f4e88b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.943060 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e02bd7-7d93-465a-bc52-baf3679b18bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.943304 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96548d64-98a7-493b-ad0f-725c1a7e30b6 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.943810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02bd7-7d93-465a-bc52-baf3679b18bf admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.944088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02bd7-7d93-465a-bc52-baf3679b18bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.944402 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02bd7-7d93-465a-bc52-baf3679b18bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.945055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e02bd7-7d93-465a-bc52-baf3679b18bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.946773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e02bd7-7d93-465a-bc52-baf3679b18bf admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.948167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b490e04-3522-4609-aefa-150a675a584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.948841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490e04-3522-4609-aefa-150a675a584e admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.949137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490e04-3522-4609-aefa-150a675a584e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.949388 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490e04-3522-4609-aefa-150a675a584e admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.950034 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b490e04-3522-4609-aefa-150a675a584e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.951614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b490e04-3522-4609-aefa-150a675a584e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.957062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 643/1278] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.957831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e02bd7-7d93-465a-bc52-baf3679b18bf admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.965405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 636/1279] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.966339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b490e04-3522-4609-aefa-150a675a584e admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:27.966962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e02bd7-7d93-465a-bc52-baf3679b18bf admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.971730 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc0e38-cd19-4f46-8a6e-d1940ae348d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.972356 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc0e38-cd19-4f46-8a6e-d1940ae348d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.972635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc0e38-cd19-4f46-8a6e-d1940ae348d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.972907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc0e38-cd19-4f46-8a6e-d1940ae348d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.973533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc0e38-cd19-4f46-8a6e-d1940ae348d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.975509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc0e38-cd19-4f46-8a6e-d1940ae348d6 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.975870 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b490e04-3522-4609-aefa-150a675a584e admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:27.980628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21efb4-a68e-4c7a-af38-609beaa65c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:27.981211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21efb4-a68e-4c7a-af38-609beaa65c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.981488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21efb4-a68e-4c7a-af38-609beaa65c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.981755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21efb4-a68e-4c7a-af38-609beaa65c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:27.982386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21efb4-a68e-4c7a-af38-609beaa65c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:27.983977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21efb4-a68e-4c7a-af38-609beaa65c7d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:27.998043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 637/1280] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:27.998043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509dddb-6f9b-434e-b946-b55b7af1503a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:27.998043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509dddb-6f9b-434e-b946-b55b7af1503a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:27.998043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509dddb-6f9b-434e-b946-b55b7af1503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.000908 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 644/1281] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:28.001803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc0e38-cd19-4f46-8a6e-d1940ae348d6 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.015802 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4509dddb-6f9b-434e-b946-b55b7af1503a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:28.017063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4509dddb-6f9b-434e-b946-b55b7af1503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:28.024652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 638/1282] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:28.027901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:28.028375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509dddb-6f9b-434e-b946-b55b7af1503a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.038931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509dddb-6f9b-434e-b946-b55b7af1503a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:28.043595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e535-3d2e-4638-aec7-bba75fdffa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:28.044324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e535-3d2e-4638-aec7-bba75fdffa68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.044594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e535-3d2e-4638-aec7-bba75fdffa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.044861 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e535-3d2e-4638-aec7-bba75fdffa68 admin admin] PATH_INFO: `/v3/projects/094bef039354476b93e57c12446706a4/users/1ea71118fe4440d18ce48d3418283c65/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.060240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e535-3d2e-4638-aec7-bba75fdffa68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094bef039354476b93e57c12446706a4, user_id=1ea71118fe4440d18ce48d3418283c65, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:28.063012 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e535-3d2e-4638-aec7-bba75fdffa68 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:28.063383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc0e38-cd19-4f46-8a6e-d1940ae348d6 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:28.067016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689d859-91ac-4a77-bae2-2ec5cff99ffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:28.067709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689d859-91ac-4a77-bae2-2ec5cff99ffe service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.067984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689d859-91ac-4a77-bae2-2ec5cff99ffe service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.068255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689d859-91ac-4a77-bae2-2ec5cff99ffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.077436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 639/1283] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:28 2022] PUT /identity/v3/projects/094bef039354476b93e57c12446706a4/users/1ea71118fe4440d18ce48d3418283c65/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:28.078764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e535-3d2e-4638-aec7-bba75fdffa68 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.080343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0036e535-3d2e-4638-aec7-bba75fdffa68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:28.126722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:28.127470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689d859-91ac-4a77-bae2-2ec5cff99ffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:28.129027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689d859-91ac-4a77-bae2-2ec5cff99ffe service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:28.137978 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 645/1284] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:28.138937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689d859-91ac-4a77-bae2-2ec5cff99ffe service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.139355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e535-3d2e-4638-aec7-bba75fdffa68 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:28.142979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6610-a411-49b8-848d-afca8c61d156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:28.143591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6610-a411-49b8-848d-afca8c61d156 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.143894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6610-a411-49b8-848d-afca8c61d156 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.144129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6610-a411-49b8-848d-afca8c61d156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.149020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689d859-91ac-4a77-bae2-2ec5cff99ffe service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:28.207101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc6081-1a84-4538-90e7-a820b17e8852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:28.207688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6081-1a84-4538-90e7-a820b17e8852 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.207968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6081-1a84-4538-90e7-a820b17e8852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.208241 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6081-1a84-4538-90e7-a820b17e8852 admin admin] PATH_INFO: `/v3/projects/a901a8a6c664467eaedc074300313138/users/8fae2e6c439b4e2894a1fdf72e75a9ae/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.208431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa6610-a411-49b8-848d-afca8c61d156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:28.210006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa6610-a411-49b8-848d-afca8c61d156 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:28.220207 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 640/1285] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:28.221074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6610-a411-49b8-848d-afca8c61d156 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.223617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc6081-1a84-4538-90e7-a820b17e8852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a901a8a6c664467eaedc074300313138, user_id=8fae2e6c439b4e2894a1fdf72e75a9ae, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:28.226668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc6081-1a84-4538-90e7-a820b17e8852 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:28.232315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6610-a411-49b8-848d-afca8c61d156 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:28.238313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad987afc-5d6f-4679-9a8a-051d954d5d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:28.239220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad987afc-5d6f-4679-9a8a-051d954d5d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.239507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad987afc-5d6f-4679-9a8a-051d954d5d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.239808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad987afc-5d6f-4679-9a8a-051d954d5d37 admin admin] PATH_INFO: `/v3/projects/5efe8793826042dc9ab48911370a7715/users/8d4c78fc725b440eb266b0365cbfcedd/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.246909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 646/1286] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:28 2022] PUT /identity/v3/projects/a901a8a6c664467eaedc074300313138/users/8fae2e6c439b4e2894a1fdf72e75a9ae/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:28.248014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc6081-1a84-4538-90e7-a820b17e8852 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.259485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad987afc-5d6f-4679-9a8a-051d954d5d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efe8793826042dc9ab48911370a7715, user_id=8d4c78fc725b440eb266b0365cbfcedd, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:28.262421 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad987afc-5d6f-4679-9a8a-051d954d5d37 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:28.280899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 641/1287] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:28 2022] PUT /identity/v3/projects/5efe8793826042dc9ab48911370a7715/users/8d4c78fc725b440eb266b0365cbfcedd/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:28.285474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad987afc-5d6f-4679-9a8a-051d954d5d37 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.331031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc6081-1a84-4538-90e7-a820b17e8852 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:28.335991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:28.370188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad987afc-5d6f-4679-9a8a-051d954d5d37 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:28.375362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea755294-ac18-44b4-855b-02a17a7c4ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:28.375965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea755294-ac18-44b4-855b-02a17a7c4ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.376242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea755294-ac18-44b4-855b-02a17a7c4ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.376547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea755294-ac18-44b4-855b-02a17a7c4ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.377397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea755294-ac18-44b4-855b-02a17a7c4ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:28.378961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea755294-ac18-44b4-855b-02a17a7c4ae8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:28.396676 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 642/1288] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:28.396676 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea755294-ac18-44b4-855b-02a17a7c4ae8 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.425386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa90d8-1dd7-415e-bbe0-5fd5df8950a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:28.426455 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa90d8-1dd7-415e-bbe0-5fd5df8950a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.426829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa90d8-1dd7-415e-bbe0-5fd5df8950a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.427207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa90d8-1dd7-415e-bbe0-5fd5df8950a5 admin admin] PATH_INFO: `/v3/projects/77a5a295985d40bebe7228dc25b3beda/users/302a3498caa34089aa69b5d0da3b307b/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.447672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa90d8-1dd7-415e-bbe0-5fd5df8950a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a5a295985d40bebe7228dc25b3beda, user_id=302a3498caa34089aa69b5d0da3b307b, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:28.452215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa90d8-1dd7-415e-bbe0-5fd5df8950a5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:28.470962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea755294-ac18-44b4-855b-02a17a7c4ae8 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:28.472539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 647/1289] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:28 2022] PUT /identity/v3/projects/77a5a295985d40bebe7228dc25b3beda/users/302a3498caa34089aa69b5d0da3b307b/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:28.473973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02930-a833-4c91-aec3-08139f1ddaa2 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.474335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02930-a833-4c91-aec3-08139f1ddaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.474813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02930-a833-4c91-aec3-08139f1ddaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.491967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:28.523550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-1cb02930-a833-4c91-aec3-08139f1ddaa2 None None] MFA Rules not processed for user `1ea71118fe4440d18ce48d3418283c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:28.525471 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1cb02930-a833-4c91-aec3-08139f1ddaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:28.555114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14828802-3a38-4507-82ac-33d2116b7711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:28.555773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14828802-3a38-4507-82ac-33d2116b7711 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.556178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14828802-3a38-4507-82ac-33d2116b7711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.556490 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14828802-3a38-4507-82ac-33d2116b7711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.616112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 648/1290] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:28.618229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ade46-de75-40ef-9a9f-69114ac22be5 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.618579 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ade46-de75-40ef-9a9f-69114ac22be5 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.618917 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ade46-de75-40ef-9a9f-69114ac22be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.649586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14828802-3a38-4507-82ac-33d2116b7711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:28.650358 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14828802-3a38-4507-82ac-33d2116b7711 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:28.663477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-632ade46-de75-40ef-9a9f-69114ac22be5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:28.665365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-632ade46-de75-40ef-9a9f-69114ac22be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:28.674732 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 649/1291] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:28.676323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779c292-1655-4719-a5c4-066ff12b1c81 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.677105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779c292-1655-4719-a5c4-066ff12b1c81 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.677592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779c292-1655-4719-a5c4-066ff12b1c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.678471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 643/1292] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:28.679152 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14828802-3a38-4507-82ac-33d2116b7711 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.700064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14828802-3a38-4507-82ac-33d2116b7711 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:28.701851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-0779c292-1655-4719-a5c4-066ff12b1c81 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:28.703229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0779c292-1655-4719-a5c4-066ff12b1c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:28.712209 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3933924-24e8-4afd-a588-396b330d2500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:28.712778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3933924-24e8-4afd-a588-396b330d2500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.713113 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3933924-24e8-4afd-a588-396b330d2500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.713323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3933924-24e8-4afd-a588-396b330d2500 admin admin] PATH_INFO: `/v3/projects/a8d99315cdd4442da5a616a945e67b94/users/fd1db857252e40d4af7d4addceae4326/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.714234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 650/1293] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:28.715861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307d76-08ae-4282-a674-eb3d3bda9b5c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:28.716421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307d76-08ae-4282-a674-eb3d3bda9b5c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:28.716909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307d76-08ae-4282-a674-eb3d3bda9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:28.774416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3933924-24e8-4afd-a588-396b330d2500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d99315cdd4442da5a616a945e67b94, user_id=fd1db857252e40d4af7d4addceae4326, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:28.777181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3933924-24e8-4afd-a588-396b330d2500 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:28.781326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-e3307d76-08ae-4282-a674-eb3d3bda9b5c None None] MFA Rules not processed for user `302a3498caa34089aa69b5d0da3b307b`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:28.781777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e3307d76-08ae-4282-a674-eb3d3bda9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:28.832608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 644/1294] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:28 2022] PUT /identity/v3/projects/a8d99315cdd4442da5a616a945e67b94/users/fd1db857252e40d4af7d4addceae4326/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:28.836263 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3933924-24e8-4afd-a588-396b330d2500 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.935221 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:28.954432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 651/1295] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:28.955742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3307d76-08ae-4282-a674-eb3d3bda9b5c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:28.967180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3307d76-08ae-4282-a674-eb3d3bda9b5c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:28.995545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3933924-24e8-4afd-a588-396b330d2500 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:29.002162 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cec716-c8e5-4483-b695-03f6b8aec42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:29.003193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cec716-c8e5-4483-b695-03f6b8aec42d admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.004100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cec716-c8e5-4483-b695-03f6b8aec42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.004854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cec716-c8e5-4483-b695-03f6b8aec42d admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.006186 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cec716-c8e5-4483-b695-03f6b8aec42d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:29.009383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cec716-c8e5-4483-b695-03f6b8aec42d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:29.037383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c49b1d-6548-4f94-830c-08782f0ce473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:29.038304 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c49b1d-6548-4f94-830c-08782f0ce473 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.038705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c49b1d-6548-4f94-830c-08782f0ce473 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.039271 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c49b1d-6548-4f94-830c-08782f0ce473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.049213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 645/1296] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:28 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:29.049977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cec716-c8e5-4483-b695-03f6b8aec42d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:29.052146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c49b1d-6548-4f94-830c-08782f0ce473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:29.054078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c49b1d-6548-4f94-830c-08782f0ce473 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:29.066052 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 652/1297] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:29.079167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c49b1d-6548-4f94-830c-08782f0ce473 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:29.089138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:29.115798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cec716-c8e5-4483-b695-03f6b8aec42d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:29.120878 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0498bc-f23f-43ab-bdff-5b36cf71d96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:29.121383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c49b1d-6548-4f94-830c-08782f0ce473 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:29.121492 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0498bc-f23f-43ab-bdff-5b36cf71d96c service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.121764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0498bc-f23f-43ab-bdff-5b36cf71d96c service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.122034 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0498bc-f23f-43ab-bdff-5b36cf71d96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.212905 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4496e5-8964-441b-9693-9f172d57147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:29.213835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4496e5-8964-441b-9693-9f172d57147c admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.214188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4496e5-8964-441b-9693-9f172d57147c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.214695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4496e5-8964-441b-9693-9f172d57147c admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.215544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4496e5-8964-441b-9693-9f172d57147c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:29.217371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4496e5-8964-441b-9693-9f172d57147c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:29.224773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0498bc-f23f-43ab-bdff-5b36cf71d96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:29.227169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0498bc-f23f-43ab-bdff-5b36cf71d96c service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:29.235499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 653/1298] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:29.235499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e998819-24bc-40f2-aefb-3f1c0c0f4a1a None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.235499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e998819-24bc-40f2-aefb-3f1c0c0f4a1a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.235499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e998819-24bc-40f2-aefb-3f1c0c0f4a1a None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.236975 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 654/1299] 10.222.0.15 () {54 vars in 961 bytes} [Mon Oct 24 13:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:12:29.237886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e998819-24bc-40f2-aefb-3f1c0c0f4a1a None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:29.243032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 646/1300] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:29.244283 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0498bc-f23f-43ab-bdff-5b36cf71d96c service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:29.254051 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e998819-24bc-40f2-aefb-3f1c0c0f4a1a None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:29.258022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0498bc-f23f-43ab-bdff-5b36cf71d96c service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:29.258987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1419bd1-11a7-404e-a9b0-29287b78cc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:29.259705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1419bd1-11a7-404e-a9b0-29287b78cc4e admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.260028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1419bd1-11a7-404e-a9b0-29287b78cc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.260476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1419bd1-11a7-404e-a9b0-29287b78cc4e admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.261386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1419bd1-11a7-404e-a9b0-29287b78cc4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:29.263581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca45b34-8722-406f-85ac-45678305f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:29.263786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1419bd1-11a7-404e-a9b0-29287b78cc4e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:29.264678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca45b34-8722-406f-85ac-45678305f435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.264844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca45b34-8722-406f-85ac-45678305f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.265122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca45b34-8722-406f-85ac-45678305f435 admin admin] PATH_INFO: `/v3/projects/a8d99315cdd4442da5a616a945e67b94/users/fd1db857252e40d4af7d4addceae4326/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.267892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca45b34-8722-406f-85ac-45678305f435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d99315cdd4442da5a616a945e67b94, user_id=fd1db857252e40d4af7d4addceae4326, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:29.270535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca45b34-8722-406f-85ac-45678305f435 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:29.288507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 647/1301] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:29 2022] PUT /identity/v3/projects/a8d99315cdd4442da5a616a945e67b94/users/fd1db857252e40d4af7d4addceae4326/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:29.290872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b20e0-fe4f-4a71-a7ec-5dec7315c941 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.291172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b20e0-fe4f-4a71-a7ec-5dec7315c941 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.291444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b20e0-fe4f-4a71-a7ec-5dec7315c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.292168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 655/1302] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:29 2022] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:29.296880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1419bd1-11a7-404e-a9b0-29287b78cc4e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:29.322261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1419bd1-11a7-404e-a9b0-29287b78cc4e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:29.407883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-974b20e0-fe4f-4a71-a7ec-5dec7315c941 None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:29.411954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-974b20e0-fe4f-4a71-a7ec-5dec7315c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:29.482146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d31ee4-650f-4007-b335-cf4d6756af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:29.485183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d31ee4-650f-4007-b335-cf4d6756af70 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.485714 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d31ee4-650f-4007-b335-cf4d6756af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.486090 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d31ee4-650f-4007-b335-cf4d6756af70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.487352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d31ee4-650f-4007-b335-cf4d6756af70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:29.490609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d31ee4-650f-4007-b335-cf4d6756af70 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:29.510992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 656/1303] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:12:29.513252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bbfff-3271-4092-9e39-a73f313f8c09 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.513831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bbfff-3271-4092-9e39-a73f313f8c09 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.514580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bbfff-3271-4092-9e39-a73f313f8c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.564931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 648/1304] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Oct 24 13:12:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:29.577353 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:29.579483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b20e0-fe4f-4a71-a7ec-5dec7315c941 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:29.586225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-e88bbfff-3271-4092-9e39-a73f313f8c09 None None] MFA Rules not processed for user `fd1db857252e40d4af7d4addceae4326`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:29.589591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e88bbfff-3271-4092-9e39-a73f313f8c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:29.605048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b20e0-fe4f-4a71-a7ec-5dec7315c941 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:29.626249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0c880-a0de-40fc-b7f5-9a071548c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:29.630502 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0c880-a0de-40fc-b7f5-9a071548c958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.630877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0c880-a0de-40fc-b7f5-9a071548c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.631199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0c880-a0de-40fc-b7f5-9a071548c958 admin admin] PATH_INFO: `/v3/projects/57aea106904c4acf8b5535cb0295878a/users/7357a9e9460c47be842ae26995255b20/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.658054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0c880-a0de-40fc-b7f5-9a071548c958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57aea106904c4acf8b5535cb0295878a, user_id=7357a9e9460c47be842ae26995255b20, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:29.664087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0c880-a0de-40fc-b7f5-9a071548c958 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:29.688223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 649/1305] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:29 2022] PUT /identity/v3/projects/57aea106904c4acf8b5535cb0295878a/users/7357a9e9460c47be842ae26995255b20/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:29.689187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0c880-a0de-40fc-b7f5-9a071548c958 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:29.742714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:29.763351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 657/1306] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:29.766383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bbfff-3271-4092-9e39-a73f313f8c09 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:29.790273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bbfff-3271-4092-9e39-a73f313f8c09 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:29.875176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993b21-2ca9-41ce-8b25-c11a9bba93f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:29.876914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993b21-2ca9-41ce-8b25-c11a9bba93f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.878173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993b21-2ca9-41ce-8b25-c11a9bba93f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.879850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993b21-2ca9-41ce-8b25-c11a9bba93f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.880552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993b21-2ca9-41ce-8b25-c11a9bba93f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:29.881139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0c880-a0de-40fc-b7f5-9a071548c958 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:29.884270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993b21-2ca9-41ce-8b25-c11a9bba93f4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:29.887496 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640da27-366a-422d-8604-6a8db68f87db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:29.888762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640da27-366a-422d-8604-6a8db68f87db service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:29.889190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640da27-366a-422d-8604-6a8db68f87db service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:29.889706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640da27-366a-422d-8604-6a8db68f87db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:29.912937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 658/1307] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:29.915688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993b21-2ca9-41ce-8b25-c11a9bba93f4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:30.003589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640da27-366a-422d-8604-6a8db68f87db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:30.005742 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640da27-366a-422d-8604-6a8db68f87db service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:30.040567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 650/1308] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:30.043571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640da27-366a-422d-8604-6a8db68f87db service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:30.068259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640da27-366a-422d-8604-6a8db68f87db service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:30.077075 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993b21-2ca9-41ce-8b25-c11a9bba93f4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:30.079609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0836c19-e80d-4ec4-9bbd-53ae7c1af68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:30.081221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0836c19-e80d-4ec4-9bbd-53ae7c1af68d admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.082664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0836c19-e80d-4ec4-9bbd-53ae7c1af68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.083056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0836c19-e80d-4ec4-9bbd-53ae7c1af68d admin admin] PATH_INFO: `/v3/projects/57aea106904c4acf8b5535cb0295878a/users/7357a9e9460c47be842ae26995255b20/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.088558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d853da4-b628-4172-aef8-773e6ad0d006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:30.090808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0836c19-e80d-4ec4-9bbd-53ae7c1af68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57aea106904c4acf8b5535cb0295878a, user_id=7357a9e9460c47be842ae26995255b20, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:30.091203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853da4-b628-4172-aef8-773e6ad0d006 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.091203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853da4-b628-4172-aef8-773e6ad0d006 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.091550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853da4-b628-4172-aef8-773e6ad0d006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.099154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0836c19-e80d-4ec4-9bbd-53ae7c1af68d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:30.120596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 651/1309] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:30 2022] PUT /identity/v3/projects/57aea106904c4acf8b5535cb0295878a/users/7357a9e9460c47be842ae26995255b20/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:30.131277 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed020b21-8d11-470b-8e53-6252c88dcf72 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.131771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed020b21-8d11-470b-8e53-6252c88dcf72 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.132175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed020b21-8d11-470b-8e53-6252c88dcf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.207309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ed020b21-8d11-470b-8e53-6252c88dcf72 None None] MFA Rules not processed for user `7357a9e9460c47be842ae26995255b20`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:30.210778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ed020b21-8d11-470b-8e53-6252c88dcf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:30.228102 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:30.254092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d853da4-b628-4172-aef8-773e6ad0d006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:30.255545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d853da4-b628-4172-aef8-773e6ad0d006 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:30.288382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 659/1310] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:30.397765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d853da4-b628-4172-aef8-773e6ad0d006 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:30.405260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 652/1311] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:12:30.407262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d853da4-b628-4172-aef8-773e6ad0d006 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:30.425733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a793dab-8c57-4179-b207-000130054457 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.425991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a793dab-8c57-4179-b207-000130054457 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.426271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a793dab-8c57-4179-b207-000130054457 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.427962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 653/1312] 10.222.0.15 () {54 vars in 961 bytes} [Mon Oct 24 13:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:12:30.441249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6159f-2d1b-4012-95a1-c75f018b8e28 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.441494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6159f-2d1b-4012-95a1-c75f018b8e28 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.441763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6159f-2d1b-4012-95a1-c75f018b8e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.476383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-45b6159f-2d1b-4012-95a1-c75f018b8e28 None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:30.479033 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-45b6159f-2d1b-4012-95a1-c75f018b8e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:30.527246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73648d-f71e-45a1-b7f3-3beb944b7612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:30.527424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:30.527888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73648d-f71e-45a1-b7f3-3beb944b7612 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.528167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73648d-f71e-45a1-b7f3-3beb944b7612 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.528470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73648d-f71e-45a1-b7f3-3beb944b7612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.614535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 654/1313] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Oct 24 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:12:30.616434 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6159f-2d1b-4012-95a1-c75f018b8e28 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:30.641215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73648d-f71e-45a1-b7f3-3beb944b7612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:30.642766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73648d-f71e-45a1-b7f3-3beb944b7612 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:30.643061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6159f-2d1b-4012-95a1-c75f018b8e28 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:30.651094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338e290-f7ef-4484-8e62-de52588833b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:30.652150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e290-f7ef-4484-8e62-de52588833b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.652659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e290-f7ef-4484-8e62-de52588833b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.653119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e290-f7ef-4484-8e62-de52588833b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.668237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 660/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:30.670513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e68049-73db-4ebc-85b2-ec3fde76d96d None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.671750 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e68049-73db-4ebc-85b2-ec3fde76d96d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.672193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e68049-73db-4ebc-85b2-ec3fde76d96d None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.676487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 661/1315] 10.222.0.15 () {54 vars in 912 bytes} [Mon Oct 24 13:12:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:12:30.679803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053dbe-864e-49c3-b3b4-20eeb3e0b15a None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.681764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053dbe-864e-49c3-b3b4-20eeb3e0b15a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.682247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053dbe-864e-49c3-b3b4-20eeb3e0b15a None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.687566 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 662/1316] 10.222.0.15 () {54 vars in 912 bytes} [Mon Oct 24 13:12:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:12:30.689203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7e30-b2ae-4f67-8aae-35fd1931fa7c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.691042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7e30-b2ae-4f67-8aae-35fd1931fa7c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.692147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7e30-b2ae-4f67-8aae-35fd1931fa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.745624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c94a7e30-b2ae-4f67-8aae-35fd1931fa7c None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:30.749055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c94a7e30-b2ae-4f67-8aae-35fd1931fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:30.774264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 663/1317] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:30.777975 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a8295-0989-46c3-8f6f-61c1b66b0fa3 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:30.779142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a8295-0989-46c3-8f6f-61c1b66b0fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:30.779596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a8295-0989-46c3-8f6f-61c1b66b0fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:30.785524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338e290-f7ef-4484-8e62-de52588833b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:30.787322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338e290-f7ef-4484-8e62-de52588833b5 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:30.802111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 655/1318] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:30.828211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8a1a8295-0989-46c3-8f6f-61c1b66b0fa3 None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:30.829704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8a1a8295-0989-46c3-8f6f-61c1b66b0fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:30.847888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 664/1319] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:31.154846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338e290-f7ef-4484-8e62-de52588833b5 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:31.191737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338e290-f7ef-4484-8e62-de52588833b5 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:31.215289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239cf5c-3d56-448b-a9e9-1faaf636ac8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:31.215929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239cf5c-3d56-448b-a9e9-1faaf636ac8c service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:31.216213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239cf5c-3d56-448b-a9e9-1faaf636ac8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:31.216571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239cf5c-3d56-448b-a9e9-1faaf636ac8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:31.228896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a8295-0989-46c3-8f6f-61c1b66b0fa3 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:31.246487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a8295-0989-46c3-8f6f-61c1b66b0fa3 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:31.251926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffca5d-6c82-4f61-9da2-40b9b53716c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:31.252615 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239cf5c-3d56-448b-a9e9-1faaf636ac8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:31.252809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffca5d-6c82-4f61-9da2-40b9b53716c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:31.253194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffca5d-6c82-4f61-9da2-40b9b53716c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:31.253565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffca5d-6c82-4f61-9da2-40b9b53716c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:31.257717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239cf5c-3d56-448b-a9e9-1faaf636ac8c service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:31.282223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffca5d-6c82-4f61-9da2-40b9b53716c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:31.283914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffca5d-6c82-4f61-9da2-40b9b53716c7 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:31.287131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 656/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:31.312912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 665/1321] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:12:34.389157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239cf5c-3d56-448b-a9e9-1faaf636ac8c service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:34.402811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239cf5c-3d56-448b-a9e9-1faaf636ac8c service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:34.418087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a13a61-d7ed-4e9c-b7c7-e95b4a3c6061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:34.423658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13a61-d7ed-4e9c-b7c7-e95b4a3c6061 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:34.424266 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13a61-d7ed-4e9c-b7c7-e95b4a3c6061 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:34.424886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13a61-d7ed-4e9c-b7c7-e95b4a3c6061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:34.454922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13a61-d7ed-4e9c-b7c7-e95b4a3c6061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:34.457043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13a61-d7ed-4e9c-b7c7-e95b4a3c6061 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:34.507532 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 657/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:35.301065 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffca5d-6c82-4f61-9da2-40b9b53716c7 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:35.466307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffca5d-6c82-4f61-9da2-40b9b53716c7 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:35.481943 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:35.482612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:35.482890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:35.483164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] PATH_INFO: `/v3/users/414595a9ea2e41cf877726950a3a14c0` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:35.485002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=414595a9ea2e41cf877726950a3a14c0)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:35.487216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:35.511379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:35.580460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414595a9ea2e41cf877726950a3a14c0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:35.605333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414595a9ea2e41cf877726950a3a14c0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:35.606412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414595a9ea2e41cf877726950a3a14c0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:35.631036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414595a9ea2e41cf877726950a3a14c0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:35.634624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414595a9ea2e41cf877726950a3a14c0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:35.670834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 666/1323] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:12:35 2022] DELETE /identity/v3/users/414595a9ea2e41cf877726950a3a14c0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:35.676644 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb95c1-4e14-4179-b2dd-95467eabfd47 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:35.676644 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb95c1-4e14-4179-b2dd-95467eabfd47 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:35.685978 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb95c1-4e14-4179-b2dd-95467eabfd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:35.722428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5ccb95c1-4e14-4179-b2dd-95467eabfd47 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:35.724603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5ccb95c1-4e14-4179-b2dd-95467eabfd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:35.897019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 658/1324] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:35.911130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:35.915805 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:36.126715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5854a6-a23f-4267-8c16-8abcb6dceee8 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:36.159628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159440e2-8c38-4b89-b3d8-2e549f8283f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:36.171026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159440e2-8c38-4b89-b3d8-2e549f8283f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:36.171408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159440e2-8c38-4b89-b3d8-2e549f8283f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:36.171990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159440e2-8c38-4b89-b3d8-2e549f8283f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:36.233491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159440e2-8c38-4b89-b3d8-2e549f8283f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:36.238519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159440e2-8c38-4b89-b3d8-2e549f8283f6 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:36.274979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 667/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:37.823314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb95c1-4e14-4179-b2dd-95467eabfd47 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:37.823314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5ccb95c1-4e14-4179-b2dd-95467eabfd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:37.839399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb95c1-4e14-4179-b2dd-95467eabfd47 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:37.861709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:37.862375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:37.862681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:37.862929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] PATH_INFO: `/v3/users/302a3498caa34089aa69b5d0da3b307b` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:37.865018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302a3498caa34089aa69b5d0da3b307b)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:37.866074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: WARNING py.warnings [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:12:37.866074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: warnings.warn(msg) Oct 24 13:12:37.866074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: Oct 24 13:12:37.867625 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:37.961045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:37.991608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302a3498caa34089aa69b5d0da3b307b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:38.023817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302a3498caa34089aa69b5d0da3b307b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:38.087148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302a3498caa34089aa69b5d0da3b307b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:38.091288 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302a3498caa34089aa69b5d0da3b307b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:38.094261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302a3498caa34089aa69b5d0da3b307b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:38.133844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 659/1326] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:12:37 2022] DELETE /identity/v3/users/302a3498caa34089aa69b5d0da3b307b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:38.138290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80edd41-a3c9-4538-a976-f2a2b56328ff None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:38.139457 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80edd41-a3c9-4538-a976-f2a2b56328ff None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:38.140024 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80edd41-a3c9-4538-a976-f2a2b56328ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:38.177660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-f80edd41-a3c9-4538-a976-f2a2b56328ff None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:38.179656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f80edd41-a3c9-4538-a976-f2a2b56328ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:38.333666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 668/1327] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:38.360094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:38.361597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:38.366042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80edd41-a3c9-4538-a976-f2a2b56328ff None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:38.368719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f80edd41-a3c9-4538-a976-f2a2b56328ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:38.389901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80edd41-a3c9-4538-a976-f2a2b56328ff None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:38.410816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:38.411716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:38.412589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:38.414095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] PATH_INFO: `/v3/projects/b031a0fcd9824a6ca580468f5316f597` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:38.416253 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b031a0fcd9824a6ca580468f5316f597)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:38.418319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: WARNING py.warnings [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 13:12:38.418319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: warnings.warn(msg) Oct 24 13:12:38.418319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: Oct 24 13:12:38.423058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:38.530509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d554-9717-43d0-8532-0266f63a3a44 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:38.535273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:38.600402 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b031a0fcd9824a6ca580468f5316f597', 'request_id': 'req-13868af6-e299-48fe-8b60-b2c52f6cefbe'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:38.627391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b031a0fcd9824a6ca580468f5316f597', 'request_id': 'req-13868af6-e299-48fe-8b60-b2c52f6cefbe'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:38.661082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b031a0fcd9824a6ca580468f5316f597', 'request_id': 'req-13868af6-e299-48fe-8b60-b2c52f6cefbe'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:38.684669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f94e02-eaae-42b3-8ab7-c0fcbe909023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:38.685278 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94e02-eaae-42b3-8ab7-c0fcbe909023 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:38.685581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94e02-eaae-42b3-8ab7-c0fcbe909023 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:38.685998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f94e02-eaae-42b3-8ab7-c0fcbe909023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:38.729062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] The token cache is being invalidate because project b031a0fcd9824a6ca580468f5316f597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:12:38.736211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:38.741058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:38.744082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 669/1328] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:12:38 2022] DELETE /identity/v3/projects/b031a0fcd9824a6ca580468f5316f597 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:38.747884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:38.750640 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:38.847252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f94e02-eaae-42b3-8ab7-c0fcbe909023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:38.855294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f94e02-eaae-42b3-8ab7-c0fcbe909023 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:38.881508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 660/1329] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:38.894056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13868af6-e299-48fe-8b60-b2c52f6cefbe admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:38.899816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:38.900780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:38.901084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:38.901366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] PATH_INFO: `/v3/users/fd1db857252e40d4af7d4addceae4326` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:38.902590 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1db857252e40d4af7d4addceae4326)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:38.904687 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:38.994215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1db857252e40d4af7d4addceae4326'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:39.008200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1db857252e40d4af7d4addceae4326'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:39.012347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1db857252e40d4af7d4addceae4326'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:39.055546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1db857252e40d4af7d4addceae4326'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:39.057180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1db857252e40d4af7d4addceae4326'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:39.065208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e5ca1-fac0-4f73-bd7c-fca52e61a6f1 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:39.065740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e5ca1-fac0-4f73-bd7c-fca52e61a6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:39.066186 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e5ca1-fac0-4f73-bd7c-fca52e61a6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:39.095560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 670/1330] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:12:38 2022] DELETE /identity/v3/users/fd1db857252e40d4af7d4addceae4326 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:39.118610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:39.127247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-411e5ca1-fac0-4f73-bd7c-fca52e61a6f1 None None] MFA Rules not processed for user `169da6fc9b04431a9fcf7580c65ab1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:39.129991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-411e5ca1-fac0-4f73-bd7c-fca52e61a6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:39.286622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 661/1331] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:12:39.316530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:39.318045 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:39.416023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:39.486839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe0b8-6913-4d84-9de4-8da1901d2ae3 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:39.500513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f6a80-4b4b-4a83-a8b3-09948a06c268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:39.500513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f6a80-4b4b-4a83-a8b3-09948a06c268 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:39.500513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f6a80-4b4b-4a83-a8b3-09948a06c268 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:39.500513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f6a80-4b4b-4a83-a8b3-09948a06c268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:39.511660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f6a80-4b4b-4a83-a8b3-09948a06c268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:39.513747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f6a80-4b4b-4a83-a8b3-09948a06c268 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:39.535098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 671/1332] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:39.535673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e5ca1-fac0-4f73-bd7c-fca52e61a6f1 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:39.540840 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-411e5ca1-fac0-4f73-bd7c-fca52e61a6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:39.682975 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e5ca1-fac0-4f73-bd7c-fca52e61a6f1 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:39.691052 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:39.691915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:39.692246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:39.692674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] PATH_INFO: `/v3/projects/77a5a295985d40bebe7228dc25b3beda` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:39.694338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a5a295985d40bebe7228dc25b3beda)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:39.697156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:39.787461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a5a295985d40bebe7228dc25b3beda', 'request_id': 'req-fc18f381-b61a-4069-839a-b76bda96f4da'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:39.808675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a5a295985d40bebe7228dc25b3beda', 'request_id': 'req-fc18f381-b61a-4069-839a-b76bda96f4da'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:39.818188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a5a295985d40bebe7228dc25b3beda', 'request_id': 'req-fc18f381-b61a-4069-839a-b76bda96f4da'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:39.865547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] The token cache is being invalidate because project 77a5a295985d40bebe7228dc25b3beda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:12:39.867342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:39.870391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fc18f381-b61a-4069-839a-b76bda96f4da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:39.876877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 662/1333] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:12:39 2022] DELETE /identity/v3/projects/77a5a295985d40bebe7228dc25b3beda => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:39.877157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e200-6fa8-4400-9468-695c47b135fa None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:39.877463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e200-6fa8-4400-9468-695c47b135fa None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:39.877761 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e200-6fa8-4400-9468-695c47b135fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:39.919206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4ed4e200-6fa8-4400-9468-695c47b135fa None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:39.920430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4ed4e200-6fa8-4400-9468-695c47b135fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:40.082187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 672/1334] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:12:40.085945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589b622-f490-4825-a818-2be0bddd38cf None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:40.086232 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589b622-f490-4825-a818-2be0bddd38cf None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:40.086526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589b622-f490-4825-a818-2be0bddd38cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:40.176508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7589b622-f490-4825-a818-2be0bddd38cf None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:40.184016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7589b622-f490-4825-a818-2be0bddd38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:40.222523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4e200-6fa8-4400-9468-695c47b135fa None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:40.225143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 663/1335] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:40.237184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4e200-6fa8-4400-9468-695c47b135fa None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:40.249476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab173b34-ee30-4008-8b58-46cfba1d06d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:40.250125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab173b34-ee30-4008-8b58-46cfba1d06d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:40.250409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab173b34-ee30-4008-8b58-46cfba1d06d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:40.250687 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab173b34-ee30-4008-8b58-46cfba1d06d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:40.256412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab173b34-ee30-4008-8b58-46cfba1d06d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:40.257149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab173b34-ee30-4008-8b58-46cfba1d06d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:40.261715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab173b34-ee30-4008-8b58-46cfba1d06d4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:40.293335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 673/1336] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:40.298411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589b622-f490-4825-a818-2be0bddd38cf None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:40.316523 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589b622-f490-4825-a818-2be0bddd38cf None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:40.339495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d47794-b9d1-44b3-9556-fe864721ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:40.340145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d47794-b9d1-44b3-9556-fe864721ace7 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:40.340626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d47794-b9d1-44b3-9556-fe864721ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:40.340912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d47794-b9d1-44b3-9556-fe864721ace7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:40.341693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d47794-b9d1-44b3-9556-fe864721ace7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:40.350180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d47794-b9d1-44b3-9556-fe864721ace7 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:40.413199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 664/1337] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:40 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:40.417566 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab173b34-ee30-4008-8b58-46cfba1d06d4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:40.434663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab173b34-ee30-4008-8b58-46cfba1d06d4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:40.540509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911effd0-059a-4ae0-b5a3-553df26d55db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:40.541737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911effd0-059a-4ae0-b5a3-553df26d55db admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:40.542025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911effd0-059a-4ae0-b5a3-553df26d55db admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:40.542453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911effd0-059a-4ae0-b5a3-553df26d55db admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:40.543228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911effd0-059a-4ae0-b5a3-553df26d55db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:40.546239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911effd0-059a-4ae0-b5a3-553df26d55db admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:40.583202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 674/1338] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:40 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:40.587464 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d47794-b9d1-44b3-9556-fe864721ace7 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:40.596482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:40.609630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d47794-b9d1-44b3-9556-fe864721ace7 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:40.617348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7a278-61b0-428c-b35e-183df040c246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:40.618568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a278-61b0-428c-b35e-183df040c246 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:40.618969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a278-61b0-428c-b35e-183df040c246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:40.619532 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a278-61b0-428c-b35e-183df040c246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:40.620929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7a278-61b0-428c-b35e-183df040c246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:40.623049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7a278-61b0-428c-b35e-183df040c246 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:40.643003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 665/1339] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:40.643997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911effd0-059a-4ae0-b5a3-553df26d55db admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:40.656074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911effd0-059a-4ae0-b5a3-553df26d55db admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:40.661506 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9746d9-7937-4254-a20e-7ed4305532b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:40.662330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9746d9-7937-4254-a20e-7ed4305532b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:40.662711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9746d9-7937-4254-a20e-7ed4305532b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:40.663084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9746d9-7937-4254-a20e-7ed4305532b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:40.664693 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9746d9-7937-4254-a20e-7ed4305532b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:40.666304 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9746d9-7937-4254-a20e-7ed4305532b1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:40.685774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7a278-61b0-428c-b35e-183df040c246 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:40.693775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 675/1340] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:12:40.700119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7a278-61b0-428c-b35e-183df040c246 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:40.707309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c03fe-5e7f-485a-a6c6-53726d3069ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:40.708136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c03fe-5e7f-485a-a6c6-53726d3069ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:40.709473 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c03fe-5e7f-485a-a6c6-53726d3069ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:40.709844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c03fe-5e7f-485a-a6c6-53726d3069ad admin admin] PATH_INFO: `/v3/projects/6c2ff44767394cfe80a28813ac94fc7d/users/e99008aeeb8f4978a49b1a872008197e/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:40.729012 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c03fe-5e7f-485a-a6c6-53726d3069ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2ff44767394cfe80a28813ac94fc7d, user_id=e99008aeeb8f4978a49b1a872008197e, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:40.732454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c03fe-5e7f-485a-a6c6-53726d3069ad admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:40.762428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 666/1341] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:40 2022] PUT /identity/v3/projects/6c2ff44767394cfe80a28813ac94fc7d/users/e99008aeeb8f4978a49b1a872008197e/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:40.777988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885270-aa15-494c-9f40-28d287bac5f6 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:40.778351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885270-aa15-494c-9f40-28d287bac5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:40.778565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885270-aa15-494c-9f40-28d287bac5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:40.859772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c03fe-5e7f-485a-a6c6-53726d3069ad admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:40.861558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ed4c03fe-5e7f-485a-a6c6-53726d3069ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:40.870995 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ab885270-aa15-494c-9f40-28d287bac5f6 None None] MFA Rules not processed for user `e99008aeeb8f4978a49b1a872008197e`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:40.872263 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ab885270-aa15-494c-9f40-28d287bac5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:40.915521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:40.997815 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c03fe-5e7f-485a-a6c6-53726d3069ad admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:41.007391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:41.009130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:41.010721 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:41.011712 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] PATH_INFO: `/v3/projects/a8d99315cdd4442da5a616a945e67b94` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:41.014444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d99315cdd4442da5a616a945e67b94)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:41.017551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:41.045079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 676/1342] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:41.051860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885270-aa15-494c-9f40-28d287bac5f6 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:41.053594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ab885270-aa15-494c-9f40-28d287bac5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:41.184175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d99315cdd4442da5a616a945e67b94', 'request_id': 'req-826061f9-a05d-4243-82c9-c849558705ef'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:41.216495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d99315cdd4442da5a616a945e67b94', 'request_id': 'req-826061f9-a05d-4243-82c9-c849558705ef'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:41.234540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d99315cdd4442da5a616a945e67b94', 'request_id': 'req-826061f9-a05d-4243-82c9-c849558705ef'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:41.269104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] The token cache is being invalidate because project a8d99315cdd4442da5a616a945e67b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:12:41.269465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:41.270321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-826061f9-a05d-4243-82c9-c849558705ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:41.275290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 667/1343] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:12:40 2022] DELETE /identity/v3/projects/a8d99315cdd4442da5a616a945e67b94 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:12:41.277088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41aa4d1-7bd3-4256-8edb-324e274b3c1a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:41.277394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41aa4d1-7bd3-4256-8edb-324e274b3c1a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:41.278177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41aa4d1-7bd3-4256-8edb-324e274b3c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:41.315496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885270-aa15-494c-9f40-28d287bac5f6 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:41.320305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b41aa4d1-7bd3-4256-8edb-324e274b3c1a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:41.321913 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b41aa4d1-7bd3-4256-8edb-324e274b3c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:41.442633 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:41.457998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 668/1344] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:12:41.467361 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3efa7-28ec-4770-b28c-4c35f05f8fe0 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:41.467655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3efa7-28ec-4770-b28c-4c35f05f8fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:41.467947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3efa7-28ec-4770-b28c-4c35f05f8fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:41.504318 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c8d3efa7-28ec-4770-b28c-4c35f05f8fe0 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:41.505560 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c8d3efa7-28ec-4770-b28c-4c35f05f8fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:41.510012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b106f-4c08-4ac5-adb2-77f308ccd1ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:41.511515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b106f-4c08-4ac5-adb2-77f308ccd1ba service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:41.513205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b106f-4c08-4ac5-adb2-77f308ccd1ba service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:41.513511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b106f-4c08-4ac5-adb2-77f308ccd1ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:41.517605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b57b106f-4c08-4ac5-adb2-77f308ccd1ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:41.527451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 669/1345] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:12:41.532041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3efa7-28ec-4770-b28c-4c35f05f8fe0 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:41.547290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3efa7-28ec-4770-b28c-4c35f05f8fe0 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:41.561388 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17954-a834-46a0-858f-d33e77d991b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:41.562040 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17954-a834-46a0-858f-d33e77d991b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:41.562339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17954-a834-46a0-858f-d33e77d991b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:41.562801 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17954-a834-46a0-858f-d33e77d991b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:41.563496 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d17954-a834-46a0-858f-d33e77d991b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:41.563804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d17954-a834-46a0-858f-d33e77d991b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:41.565610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d17954-a834-46a0-858f-d33e77d991b0 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:41.603765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 670/1346] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:12:41.606182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17954-a834-46a0-858f-d33e77d991b0 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:41.631028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17954-a834-46a0-858f-d33e77d991b0 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:41.645378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd2438-5c24-4de9-9089-d1ea9c317b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:41.646158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd2438-5c24-4de9-9089-d1ea9c317b34 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:41.646450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd2438-5c24-4de9-9089-d1ea9c317b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:41.646732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd2438-5c24-4de9-9089-d1ea9c317b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:41.647509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd2438-5c24-4de9-9089-d1ea9c317b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:41.650223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd2438-5c24-4de9-9089-d1ea9c317b34 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:41.704111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:41.706606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 671/1347] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:41 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:41.710820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd2438-5c24-4de9-9089-d1ea9c317b34 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:41.713847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b106f-4c08-4ac5-adb2-77f308ccd1ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:41.717201 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b106f-4c08-4ac5-adb2-77f308ccd1ba service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:41.747895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 677/1348] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:12:41.768646 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b106f-4c08-4ac5-adb2-77f308ccd1ba service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:41.771067 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b57b106f-4c08-4ac5-adb2-77f308ccd1ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:41.802746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b106f-4c08-4ac5-adb2-77f308ccd1ba service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:41.874666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd2438-5c24-4de9-9089-d1ea9c317b34 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:41.891362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080523b-2485-4973-bf7e-2b43fb1a4bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:41.894069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080523b-2485-4973-bf7e-2b43fb1a4bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:41.894069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080523b-2485-4973-bf7e-2b43fb1a4bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:41.894069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080523b-2485-4973-bf7e-2b43fb1a4bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:41.894636 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080523b-2485-4973-bf7e-2b43fb1a4bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:41.905082 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080523b-2485-4973-bf7e-2b43fb1a4bd1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:41.965821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 672/1349] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:41 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:12:41.967000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080523b-2485-4973-bf7e-2b43fb1a4bd1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:42.005160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080523b-2485-4973-bf7e-2b43fb1a4bd1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:42.023999 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fafe1e-eb26-4a89-a761-e22442a009b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:42.026008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fafe1e-eb26-4a89-a761-e22442a009b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:42.026297 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fafe1e-eb26-4a89-a761-e22442a009b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:42.026658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fafe1e-eb26-4a89-a761-e22442a009b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:42.028046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fafe1e-eb26-4a89-a761-e22442a009b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:42.029766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fafe1e-eb26-4a89-a761-e22442a009b9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:42.032575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:42.033238 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:42.033931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:42.034211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] PATH_INFO: `/v3/users/c9a931949bd1466e8e2d5ae0f0226d31` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:42.037796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a931949bd1466e8e2d5ae0f0226d31)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:42.040882 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:42.067002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 673/1350] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:42.072433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fafe1e-eb26-4a89-a761-e22442a009b9 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:42.109822 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fafe1e-eb26-4a89-a761-e22442a009b9 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:42.130911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8459f-dfc9-4416-848e-42c0129a018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:42.131540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8459f-dfc9-4416-848e-42c0129a018e admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:42.131823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8459f-dfc9-4416-848e-42c0129a018e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:42.132312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8459f-dfc9-4416-848e-42c0129a018e admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:42.132965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8459f-dfc9-4416-848e-42c0129a018e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:42.135108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8459f-dfc9-4416-848e-42c0129a018e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:42.164941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 674/1351] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:12:42.176119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8459f-dfc9-4416-848e-42c0129a018e admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:42.199140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8459f-dfc9-4416-848e-42c0129a018e admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:42.202227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a931949bd1466e8e2d5ae0f0226d31'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:42.208481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a36ab-5900-4bad-8e2a-cb6d53d45970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:42.210608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a36ab-5900-4bad-8e2a-cb6d53d45970 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:42.211229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a36ab-5900-4bad-8e2a-cb6d53d45970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:42.211680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a36ab-5900-4bad-8e2a-cb6d53d45970 admin admin] PATH_INFO: `/v3/projects/d06cd9f37b3148d88598121506aebdb2/users/986b17ff979543eaaa070f1e2d388944/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:42.229873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a931949bd1466e8e2d5ae0f0226d31'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:42.231209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a931949bd1466e8e2d5ae0f0226d31'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:42.251580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a36ab-5900-4bad-8e2a-cb6d53d45970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06cd9f37b3148d88598121506aebdb2, user_id=986b17ff979543eaaa070f1e2d388944, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:42.254912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a36ab-5900-4bad-8e2a-cb6d53d45970 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:42.265325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a931949bd1466e8e2d5ae0f0226d31'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:42.266103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4ba590a7-8a28-4607-887a-667e7f85602f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a931949bd1466e8e2d5ae0f0226d31'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:42.285334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 675/1352] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:42 2022] PUT /identity/v3/projects/d06cd9f37b3148d88598121506aebdb2/users/986b17ff979543eaaa070f1e2d388944/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:42.295726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38164518-4ac8-4b93-9d7a-f93a85b46e32 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:42.296016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38164518-4ac8-4b93-9d7a-f93a85b46e32 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:42.296317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38164518-4ac8-4b93-9d7a-f93a85b46e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:42.304348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 678/1353] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:12:41 2022] DELETE /identity/v3/users/c9a931949bd1466e8e2d5ae0f0226d31 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:42.306180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417f9d5-811d-4b41-8a89-359bbd2cc72e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:42.306481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417f9d5-811d-4b41-8a89-359bbd2cc72e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:42.306760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417f9d5-811d-4b41-8a89-359bbd2cc72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:42.349655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9417f9d5-811d-4b41-8a89-359bbd2cc72e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:42.351078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9417f9d5-811d-4b41-8a89-359bbd2cc72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:42.361986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-38164518-4ac8-4b93-9d7a-f93a85b46e32 None None] MFA Rules not processed for user `986b17ff979543eaaa070f1e2d388944`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:42.363255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-38164518-4ac8-4b93-9d7a-f93a85b46e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:42.494355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:42.506079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 679/1354] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:12:42.539169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 676/1355] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:42.544267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417f9d5-811d-4b41-8a89-359bbd2cc72e None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:42.546025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9417f9d5-811d-4b41-8a89-359bbd2cc72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:42.555818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38164518-4ac8-4b93-9d7a-f93a85b46e32 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:42.557324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-38164518-4ac8-4b93-9d7a-f93a85b46e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:42.581462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417f9d5-811d-4b41-8a89-359bbd2cc72e None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:42.596706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e21a4-9468-44fd-905f-a5510cc0e6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:42.597339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e21a4-9468-44fd-905f-a5510cc0e6ba admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:42.597611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e21a4-9468-44fd-905f-a5510cc0e6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:42.597875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e21a4-9468-44fd-905f-a5510cc0e6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:42.598516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e21a4-9468-44fd-905f-a5510cc0e6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:42.603349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e21a4-9468-44fd-905f-a5510cc0e6ba admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:42.631603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:42.677175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 680/1356] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:42 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:42.682549 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e21a4-9468-44fd-905f-a5510cc0e6ba admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:42.693343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38164518-4ac8-4b93-9d7a-f93a85b46e32 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:42.779709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07346f-c5ea-41af-a8cf-62577bad2deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:42.780735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07346f-c5ea-41af-a8cf-62577bad2deb service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:42.781524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07346f-c5ea-41af-a8cf-62577bad2deb service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:42.782007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07346f-c5ea-41af-a8cf-62577bad2deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:42.855809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e21a4-9468-44fd-905f-a5510cc0e6ba admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:42.873074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca168c3-42af-4372-94d9-f413ef45d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:42.875119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca168c3-42af-4372-94d9-f413ef45d5bb admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:42.875704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca168c3-42af-4372-94d9-f413ef45d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:42.876197 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca168c3-42af-4372-94d9-f413ef45d5bb admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:42.877670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca168c3-42af-4372-94d9-f413ef45d5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:42.881301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca168c3-42af-4372-94d9-f413ef45d5bb admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:42.936099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 681/1357] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:42 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:42.940003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca168c3-42af-4372-94d9-f413ef45d5bb admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:42.941224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07346f-c5ea-41af-a8cf-62577bad2deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:42.944168 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07346f-c5ea-41af-a8cf-62577bad2deb service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:42.972837 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 677/1358] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:42.975848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca168c3-42af-4372-94d9-f413ef45d5bb admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:42.998723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645db35-60db-4577-a861-56cb098210c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:43.001087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645db35-60db-4577-a861-56cb098210c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:43.001623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645db35-60db-4577-a861-56cb098210c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:43.002113 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645db35-60db-4577-a861-56cb098210c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:43.003031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645db35-60db-4577-a861-56cb098210c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:43.005605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645db35-60db-4577-a861-56cb098210c4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:43.019977 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 682/1359] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:12:43.024218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07346f-c5ea-41af-a8cf-62577bad2deb service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:43.037341 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07346f-c5ea-41af-a8cf-62577bad2deb service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:43.043092 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221c3e-4fb9-4324-b27e-72e5f25dbe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:43.044164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221c3e-4fb9-4324-b27e-72e5f25dbe18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:43.044571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221c3e-4fb9-4324-b27e-72e5f25dbe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:43.044949 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221c3e-4fb9-4324-b27e-72e5f25dbe18 admin admin] PATH_INFO: `/v3/projects/d4a551aecde842809bf8c4d0085b6f94/users/e6c0ff9cbf4b4f74b3b62930d31fac9d/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:43.088285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af221c3e-4fb9-4324-b27e-72e5f25dbe18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a551aecde842809bf8c4d0085b6f94, user_id=e6c0ff9cbf4b4f74b3b62930d31fac9d, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:43.096815 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af221c3e-4fb9-4324-b27e-72e5f25dbe18 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:43.140425 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 678/1360] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:43 2022] PUT /identity/v3/projects/d4a551aecde842809bf8c4d0085b6f94/users/e6c0ff9cbf4b4f74b3b62930d31fac9d/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:43.144007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645db35-60db-4577-a861-56cb098210c4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:43.162464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645db35-60db-4577-a861-56cb098210c4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:43.338922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178dd8c-dc98-45b0-8ca2-f6a5ad7d5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:43.340486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178dd8c-dc98-45b0-8ca2-f6a5ad7d5ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:43.341167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178dd8c-dc98-45b0-8ca2-f6a5ad7d5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:43.341600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178dd8c-dc98-45b0-8ca2-f6a5ad7d5ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:43.343304 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178dd8c-dc98-45b0-8ca2-f6a5ad7d5ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:43.346266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178dd8c-dc98-45b0-8ca2-f6a5ad7d5ea6 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:43.365506 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 683/1361] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:12:43.369893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221c3e-4fb9-4324-b27e-72e5f25dbe18 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:43.383757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221c3e-4fb9-4324-b27e-72e5f25dbe18 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:43.398369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93359a-8e71-461e-adad-58c94fc0c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:43.399200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93359a-8e71-461e-adad-58c94fc0c678 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:43.399538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93359a-8e71-461e-adad-58c94fc0c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:43.400397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93359a-8e71-461e-adad-58c94fc0c678 admin admin] PATH_INFO: `/v3/projects/d4a551aecde842809bf8c4d0085b6f94/users/e6c0ff9cbf4b4f74b3b62930d31fac9d/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:43.403123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93359a-8e71-461e-adad-58c94fc0c678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a551aecde842809bf8c4d0085b6f94, user_id=e6c0ff9cbf4b4f74b3b62930d31fac9d, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:43.405464 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93359a-8e71-461e-adad-58c94fc0c678 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:43.421536 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 679/1362] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:43 2022] PUT /identity/v3/projects/d4a551aecde842809bf8c4d0085b6f94/users/e6c0ff9cbf4b4f74b3b62930d31fac9d/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:43.432644 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334b65-1ad8-458d-a9da-3ed4ac92fc3e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:43.433297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334b65-1ad8-458d-a9da-3ed4ac92fc3e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:43.433849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334b65-1ad8-458d-a9da-3ed4ac92fc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:43.504212 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9b334b65-1ad8-458d-a9da-3ed4ac92fc3e None None] MFA Rules not processed for user `e6c0ff9cbf4b4f74b3b62930d31fac9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:43.506383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9b334b65-1ad8-458d-a9da-3ed4ac92fc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:43.705154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:43.768262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 684/1363] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:43.782080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93359a-8e71-461e-adad-58c94fc0c678 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:43.784778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1b93359a-8e71-461e-adad-58c94fc0c678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:43.892517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:44.029030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93359a-8e71-461e-adad-58c94fc0c678 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:44.042014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7ab9d-98b5-409c-bcbd-0a22cd7c1ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:44.043290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ab9d-98b5-409c-bcbd-0a22cd7c1ecf service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:44.043572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ab9d-98b5-409c-bcbd-0a22cd7c1ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:44.046322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ab9d-98b5-409c-bcbd-0a22cd7c1ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:44.090353 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7ab9d-98b5-409c-bcbd-0a22cd7c1ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:44.093116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7ab9d-98b5-409c-bcbd-0a22cd7c1ecf service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:44.124235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 680/1364] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:44.795463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04af07-6b46-41e4-80bd-1dd6cabfe101 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:44.795463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04af07-6b46-41e4-80bd-1dd6cabfe101 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:44.795463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04af07-6b46-41e4-80bd-1dd6cabfe101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:44.853656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-6e04af07-6b46-41e4-80bd-1dd6cabfe101 None None] MFA Rules not processed for user `169da6fc9b04431a9fcf7580c65ab1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:44.854930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6e04af07-6b46-41e4-80bd-1dd6cabfe101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:45.092616 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 685/1365] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:45.119226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7ab9d-98b5-409c-bcbd-0a22cd7c1ecf service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:45.139245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7ab9d-98b5-409c-bcbd-0a22cd7c1ecf service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:45.160059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614bd4-fdfe-40bb-ab2a-937c75be3a2d tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6c0ff9cbf4b4f74b3b62930d31fac9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a551aecde842809bf8c4d0085b6f94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:45.167369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614bd4-fdfe-40bb-ab2a-937c75be3a2d tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:45.167712 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614bd4-fdfe-40bb-ab2a-937c75be3a2d tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:45.167988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614bd4-fdfe-40bb-ab2a-937c75be3a2d tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:45.174268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81614bd4-fdfe-40bb-ab2a-937c75be3a2d tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:45.179124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81614bd4-fdfe-40bb-ab2a-937c75be3a2d tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:45.180982 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81614bd4-fdfe-40bb-ab2a-937c75be3a2d tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:45.220128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 681/1366] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:45.224498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04af07-6b46-41e4-80bd-1dd6cabfe101 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:45.244152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04af07-6b46-41e4-80bd-1dd6cabfe101 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:45.257918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758a8aa-2386-4ff3-9623-60849fe94bba tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6c0ff9cbf4b4f74b3b62930d31fac9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a551aecde842809bf8c4d0085b6f94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:45.260017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a8aa-2386-4ff3-9623-60849fe94bba tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:45.261534 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a8aa-2386-4ff3-9623-60849fe94bba tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:45.261966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a8aa-2386-4ff3-9623-60849fe94bba tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:45.262815 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758a8aa-2386-4ff3-9623-60849fe94bba tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:45.272763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758a8aa-2386-4ff3-9623-60849fe94bba tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:45.349067 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 686/1367] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:45 2022] POST /identity/v3/projects => generated 354 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:45.353734 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614bd4-fdfe-40bb-ab2a-937c75be3a2d tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:45.370407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614bd4-fdfe-40bb-ab2a-937c75be3a2d tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:45.419082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6cc7f-19b1-42c0-96f6-f50d97556421 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:45.419699 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6cc7f-19b1-42c0-96f6-f50d97556421 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:45.420671 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6cc7f-19b1-42c0-96f6-f50d97556421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:45.501404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-e2a6cc7f-19b1-42c0-96f6-f50d97556421 None None] MFA Rules not processed for user `0b96ce275ce04db9b46265361e06a483`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:45.502630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e2a6cc7f-19b1-42c0-96f6-f50d97556421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:45.531558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4980e19-f2dc-409f-a00b-909dac171fa2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6c0ff9cbf4b4f74b3b62930d31fac9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a551aecde842809bf8c4d0085b6f94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:45.532671 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4980e19-f2dc-409f-a00b-909dac171fa2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:45.533119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4980e19-f2dc-409f-a00b-909dac171fa2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:45.533630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4980e19-f2dc-409f-a00b-909dac171fa2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:45.534440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4980e19-f2dc-409f-a00b-909dac171fa2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:45.535824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4980e19-f2dc-409f-a00b-909dac171fa2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:45.541405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4980e19-f2dc-409f-a00b-909dac171fa2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:45.582167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 682/1368] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:45.582983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4980e19-f2dc-409f-a00b-909dac171fa2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:45.586665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d4980e19-f2dc-409f-a00b-909dac171fa2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:45.749116 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 687/1369] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:45.750142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6cc7f-19b1-42c0-96f6-f50d97556421 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:45.769075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4980e19-f2dc-409f-a00b-909dac171fa2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:45.788350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:45.789525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6cc7f-19b1-42c0-96f6-f50d97556421 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:45.789798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:45.790214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:45.790623 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] PATH_INFO: `/v3/users/e99008aeeb8f4978a49b1a872008197e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:45.791991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99008aeeb8f4978a49b1a872008197e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:45.794248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:45.807669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6c0ff9cbf4b4f74b3b62930d31fac9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a551aecde842809bf8c4d0085b6f94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:45.814006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:45.814464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:45.816379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] PATH_INFO: `/v3/projects/a847796b21f547a192ccdabd4aedf713` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:45.819830 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a847796b21f547a192ccdabd4aedf713)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:45.822784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:45.909690 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:45.922288 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99008aeeb8f4978a49b1a872008197e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:45.940209 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99008aeeb8f4978a49b1a872008197e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:45.955459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a847796b21f547a192ccdabd4aedf713', 'request_id': 'req-a94220a5-7363-4247-ac00-1fae35c31df2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:45.965196 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a847796b21f547a192ccdabd4aedf713', 'request_id': 'req-a94220a5-7363-4247-ac00-1fae35c31df2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:45.966774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:45.975208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a847796b21f547a192ccdabd4aedf713', 'request_id': 'req-a94220a5-7363-4247-ac00-1fae35c31df2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:45.991758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99008aeeb8f4978a49b1a872008197e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:45.993286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99008aeeb8f4978a49b1a872008197e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:45.994253 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96ea5de2-361b-4ac8-b449-cf4c2803fea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99008aeeb8f4978a49b1a872008197e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:46.004266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] The token cache is being invalidate because project a847796b21f547a192ccdabd4aedf713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:12:46.004946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:46.007655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a94220a5-7363-4247-ac00-1fae35c31df2 tempest-VolumeQuotaClassesTest-1828244553 tempest-VolumeQuotaClassesTest-1828244553-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:46.010535 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 688/1370] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:12:45 2022] DELETE /identity/v3/projects/a847796b21f547a192ccdabd4aedf713 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:46.012570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e77cd-625c-451c-a286-1ef8d7d0cf24 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:46.013233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e77cd-625c-451c-a286-1ef8d7d0cf24 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:46.014026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e77cd-625c-451c-a286-1ef8d7d0cf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:46.026333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 683/1371] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:12:45 2022] DELETE /identity/v3/users/e99008aeeb8f4978a49b1a872008197e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:46.030907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2138-cb31-4a1a-b0fa-a7ea470b420f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:46.031366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2138-cb31-4a1a-b0fa-a7ea470b420f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:46.031780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2138-cb31-4a1a-b0fa-a7ea470b420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:46.040837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5b4e77cd-625c-451c-a286-1ef8d7d0cf24 None None] MFA Rules not processed for user `0b96ce275ce04db9b46265361e06a483`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:46.047626 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5b4e77cd-625c-451c-a286-1ef8d7d0cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:46.106689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4d6d2138-cb31-4a1a-b0fa-a7ea470b420f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:46.108694 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4d6d2138-cb31-4a1a-b0fa-a7ea470b420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:46.282149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 689/1372] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:46.283246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e77cd-625c-451c-a286-1ef8d7d0cf24 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:46.285371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5b4e77cd-625c-451c-a286-1ef8d7d0cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:46.344650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 684/1373] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:12:46.348712 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d2138-cb31-4a1a-b0fa-a7ea470b420f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:46.354145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4d6d2138-cb31-4a1a-b0fa-a7ea470b420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:46.468025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e77cd-625c-451c-a286-1ef8d7d0cf24 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:46.487394 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:46.490818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:46.491438 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:46.491731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] PATH_INFO: `/v3/projects/5f59afaf69aa444ea2b73b5b03c1f11a` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:46.501666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f59afaf69aa444ea2b73b5b03c1f11a)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:46.510601 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:46.537225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d2138-cb31-4a1a-b0fa-a7ea470b420f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:46.544679 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c1ad3-8f52-4fc6-8763-23c012d2c0c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:46.545410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c1ad3-8f52-4fc6-8763-23c012d2c0c3 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:46.545902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c1ad3-8f52-4fc6-8763-23c012d2c0c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:46.546274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c1ad3-8f52-4fc6-8763-23c012d2c0c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:46.548889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-935c1ad3-8f52-4fc6-8763-23c012d2c0c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:46.581271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c1ad3-8f52-4fc6-8763-23c012d2c0c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:46.584657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c1ad3-8f52-4fc6-8763-23c012d2c0c3 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:46.622710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 685/1374] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:46.626209 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c1ad3-8f52-4fc6-8763-23c012d2c0c3 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:46.631876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-935c1ad3-8f52-4fc6-8763-23c012d2c0c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:46.648743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f59afaf69aa444ea2b73b5b03c1f11a', 'request_id': 'req-9466d012-7ba1-43da-b052-1a3736cf872a'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:46.666726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f59afaf69aa444ea2b73b5b03c1f11a', 'request_id': 'req-9466d012-7ba1-43da-b052-1a3736cf872a'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:46.674799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f59afaf69aa444ea2b73b5b03c1f11a', 'request_id': 'req-9466d012-7ba1-43da-b052-1a3736cf872a'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:46.694018 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] The token cache is being invalidate because project 5f59afaf69aa444ea2b73b5b03c1f11a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:12:46.694473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:46.696114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:46.698683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 690/1375] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:12:46 2022] DELETE /identity/v3/projects/5f59afaf69aa444ea2b73b5b03c1f11a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:46.699878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:46.701701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:46.744804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:46.822715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:46.833316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c1ad3-8f52-4fc6-8763-23c012d2c0c3 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:46.864698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466d012-7ba1-43da-b052-1a3736cf872a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:46.870900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:46.871709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:46.872090 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:46.872464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] PATH_INFO: `/v3/users/986b17ff979543eaaa070f1e2d388944` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:46.873971 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=986b17ff979543eaaa070f1e2d388944)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:46.876114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:46.957452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548184b1-e3a7-4031-ba7f-ae07d3e844bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:46.962413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548184b1-e3a7-4031-ba7f-ae07d3e844bb service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:46.962738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548184b1-e3a7-4031-ba7f-ae07d3e844bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:46.964395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548184b1-e3a7-4031-ba7f-ae07d3e844bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:46.972069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-548184b1-e3a7-4031-ba7f-ae07d3e844bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:46.986076 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986b17ff979543eaaa070f1e2d388944'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:47.002079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986b17ff979543eaaa070f1e2d388944'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:47.004488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986b17ff979543eaaa070f1e2d388944'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:47.024025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548184b1-e3a7-4031-ba7f-ae07d3e844bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:47.024025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548184b1-e3a7-4031-ba7f-ae07d3e844bb service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:47.032932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986b17ff979543eaaa070f1e2d388944'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:47.033896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-551cf457-e279-4eb0-aa87-966fab8069e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986b17ff979543eaaa070f1e2d388944'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:47.036336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 686/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:47.052220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeb958-1164-42b5-9e09-bbd0514661f9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.052701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeb958-1164-42b5-9e09-bbd0514661f9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.053103 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeb958-1164-42b5-9e09-bbd0514661f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.058798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 691/1377] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:12:46 2022] DELETE /identity/v3/users/986b17ff979543eaaa070f1e2d388944 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:47.060646 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830542f8-7709-4f66-94b2-019e94ea9755 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.061014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830542f8-7709-4f66-94b2-019e94ea9755 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.061513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830542f8-7709-4f66-94b2-019e94ea9755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.085669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3adeb958-1164-42b5-9e09-bbd0514661f9 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:47.087203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3adeb958-1164-42b5-9e09-bbd0514661f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:47.119338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-830542f8-7709-4f66-94b2-019e94ea9755 None None] MFA Rules not processed for user `8d4c78fc725b440eb266b0365cbfcedd`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:47.128513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-830542f8-7709-4f66-94b2-019e94ea9755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:47.247407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 687/1378] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:47.249102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429cd4-c4d6-4ab6-bf3e-3061cea50fb0 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.249550 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429cd4-c4d6-4ab6-bf3e-3061cea50fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.249956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429cd4-c4d6-4ab6-bf3e-3061cea50fb0 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.251471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 688/1379] 10.222.0.15 () {54 vars in 912 bytes} [Mon Oct 24 13:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:12:47.252703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bfeb3-12d9-4d20-bc2c-58f0b3905035 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.256663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bfeb3-12d9-4d20-bc2c-58f0b3905035 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.257183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bfeb3-12d9-4d20-bc2c-58f0b3905035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.282647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 692/1380] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:47.282647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe9f3-b226-4703-b18d-b5296963a592 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.282647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe9f3-b226-4703-b18d-b5296963a592 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.282647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe9f3-b226-4703-b18d-b5296963a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.315430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-1cefe9f3-b226-4703-b18d-b5296963a592 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:47.319826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-166bfeb3-12d9-4d20-bc2c-58f0b3905035 None None] MFA Rules not processed for user `8fae2e6c439b4e2894a1fdf72e75a9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:47.320444 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1cefe9f3-b226-4703-b18d-b5296963a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:47.321372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-166bfeb3-12d9-4d20-bc2c-58f0b3905035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:47.329324 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 693/1381] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:47.331108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d788ed6-50cb-45a9-a300-7cc8366ff819 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.331465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d788ed6-50cb-45a9-a300-7cc8366ff819 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.331809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d788ed6-50cb-45a9-a300-7cc8366ff819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.375930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8d788ed6-50cb-45a9-a300-7cc8366ff819 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:47.376866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8d788ed6-50cb-45a9-a300-7cc8366ff819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:47.393488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 694/1382] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:47.403923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c3423-767f-4e25-97a4-f41f5ee4cff8 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.404287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c3423-767f-4e25-97a4-f41f5ee4cff8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.404657 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c3423-767f-4e25-97a4-f41f5ee4cff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.467944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:47.488829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-818c3423-767f-4e25-97a4-f41f5ee4cff8 None None] MFA Rules not processed for user `974f2acdadf14df69cbe33351ee02a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:47.490439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-818c3423-767f-4e25-97a4-f41f5ee4cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:47.493544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 689/1383] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:47.507439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bfeb3-12d9-4d20-bc2c-58f0b3905035 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:47.511786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-166bfeb3-12d9-4d20-bc2c-58f0b3905035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:47.590708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:47.610901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 695/1384] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:47.619947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c3423-767f-4e25-97a4-f41f5ee4cff8 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:47.623477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bfeb3-12d9-4d20-bc2c-58f0b3905035 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:47.627573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713365f-9148-4e4e-b87f-9d792d5d2a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:47.628089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713365f-9148-4e4e-b87f-9d792d5d2a7f service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.628403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713365f-9148-4e4e-b87f-9d792d5d2a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.628989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713365f-9148-4e4e-b87f-9d792d5d2a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.640942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713365f-9148-4e4e-b87f-9d792d5d2a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:47.642639 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713365f-9148-4e4e-b87f-9d792d5d2a7f service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:47.645502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c3423-767f-4e25-97a4-f41f5ee4cff8 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:47.654673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada030f-89f2-4145-9d1a-7bb72a76239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:47.655556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada030f-89f2-4145-9d1a-7bb72a76239f admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.656021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada030f-89f2-4145-9d1a-7bb72a76239f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.656670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada030f-89f2-4145-9d1a-7bb72a76239f admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.657529 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada030f-89f2-4145-9d1a-7bb72a76239f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:47.658019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada030f-89f2-4145-9d1a-7bb72a76239f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:47.660519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada030f-89f2-4145-9d1a-7bb72a76239f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:47.687584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 690/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:47.693766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 696/1386] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:47.693766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c103cab-f223-48be-968b-af17407096f9 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.693766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c103cab-f223-48be-968b-af17407096f9 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.693766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c103cab-f223-48be-968b-af17407096f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.697807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dba27-458b-41d3-86a6-a4faa0cbf4fc None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.701514 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dba27-458b-41d3-86a6-a4faa0cbf4fc None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.703179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dba27-458b-41d3-86a6-a4faa0cbf4fc None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.715234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 691/1387] 10.222.0.15 () {54 vars in 912 bytes} [Mon Oct 24 13:12:47 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:12:47.719383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dba27-458b-41d3-86a6-a4faa0cbf4fc None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:47.732645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8c103cab-f223-48be-968b-af17407096f9 None None] MFA Rules not processed for user `8fae2e6c439b4e2894a1fdf72e75a9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:47.734261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8c103cab-f223-48be-968b-af17407096f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:47.746374 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 697/1388] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:47.747262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c103cab-f223-48be-968b-af17407096f9 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:47.782592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dba27-458b-41d3-86a6-a4faa0cbf4fc None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:47.787932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c103cab-f223-48be-968b-af17407096f9 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:47.796955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4df2cd-0013-45aa-8da6-c3239daf33a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:47.799340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df2cd-0013-45aa-8da6-c3239daf33a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.800422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df2cd-0013-45aa-8da6-c3239daf33a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.800719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df2cd-0013-45aa-8da6-c3239daf33a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.815526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdb2c0-64bf-454b-82de-9ea562bf422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:47.817225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdb2c0-64bf-454b-82de-9ea562bf422d admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.819027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdb2c0-64bf-454b-82de-9ea562bf422d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.822203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdb2c0-64bf-454b-82de-9ea562bf422d admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.823858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdb2c0-64bf-454b-82de-9ea562bf422d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:47.833292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdb2c0-64bf-454b-82de-9ea562bf422d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:47.843028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4df2cd-0013-45aa-8da6-c3239daf33a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:47.853764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4df2cd-0013-45aa-8da6-c3239daf33a0 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:47.893548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 692/1389] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:47.895535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596934-5bcd-4be9-96be-98ee59a38e56 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:47.896120 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596934-5bcd-4be9-96be-98ee59a38e56 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:47.896506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596934-5bcd-4be9-96be-98ee59a38e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:47.975586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 698/1390] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:47 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:47.993918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdb2c0-64bf-454b-82de-9ea562bf422d admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:47.999248 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-34cdb2c0-64bf-454b-82de-9ea562bf422d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:48.016616 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2e596934-5bcd-4be9-96be-98ee59a38e56 None None] MFA Rules not processed for user `974f2acdadf14df69cbe33351ee02a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:48.017890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2e596934-5bcd-4be9-96be-98ee59a38e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:48.215321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 693/1391] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:48.218043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e596934-5bcd-4be9-96be-98ee59a38e56 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:48.228944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdb2c0-64bf-454b-82de-9ea562bf422d admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:48.246965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:48.247658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:48.247940 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:48.250701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] PATH_INFO: `/v3/projects/6c2ff44767394cfe80a28813ac94fc7d` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:48.252627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e596934-5bcd-4be9-96be-98ee59a38e56 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:48.253966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2ff44767394cfe80a28813ac94fc7d)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:48.255908 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:48.266990 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c374b6-a39f-4406-8b86-1fbe71c07b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:48.267833 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c374b6-a39f-4406-8b86-1fbe71c07b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:48.267938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c374b6-a39f-4406-8b86-1fbe71c07b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:48.268174 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c374b6-a39f-4406-8b86-1fbe71c07b03 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:48.273574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c374b6-a39f-4406-8b86-1fbe71c07b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:48.275377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c374b6-a39f-4406-8b86-1fbe71c07b03 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:48.333282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 694/1392] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:48 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:48.334336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c374b6-a39f-4406-8b86-1fbe71c07b03 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:48.339050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f4c374b6-a39f-4406-8b86-1fbe71c07b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:48.382546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c374b6-a39f-4406-8b86-1fbe71c07b03 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:48.394355 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2ff44767394cfe80a28813ac94fc7d', 'request_id': 'req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:48.406804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2ff44767394cfe80a28813ac94fc7d', 'request_id': 'req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:48.419602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2ff44767394cfe80a28813ac94fc7d', 'request_id': 'req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:48.451080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] The token cache is being invalidate because project 6c2ff44767394cfe80a28813ac94fc7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:12:48.452100 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:48.454631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:48.456722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 699/1393] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:12:47 2022] DELETE /identity/v3/projects/6c2ff44767394cfe80a28813ac94fc7d => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:48.463809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:48.484284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:48.505946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:48.554640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292df16-0727-4997-8fd6-aba947f2fe5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:48.556844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292df16-0727-4997-8fd6-aba947f2fe5a service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:48.557152 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292df16-0727-4997-8fd6-aba947f2fe5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:48.557431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292df16-0727-4997-8fd6-aba947f2fe5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:48.565043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b292df16-0727-4997-8fd6-aba947f2fe5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:48.592866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292df16-0727-4997-8fd6-aba947f2fe5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:48.595083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292df16-0727-4997-8fd6-aba947f2fe5a service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:48.633796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 695/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:48.635371 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fe81b-41bb-4d57-8d69-89c641df7a3a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:48.635839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fe81b-41bb-4d57-8d69-89c641df7a3a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:48.636402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fe81b-41bb-4d57-8d69-89c641df7a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:48.702582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1a6fe81b-41bb-4d57-8d69-89c641df7a3a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:48.713432 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1a6fe81b-41bb-4d57-8d69-89c641df7a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:48.734218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 696/1395] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:48.742453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec5e9c-c87a-4550-bf9a-ab7a66e0924f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:48.742617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84220b3-e9e2-490e-a873-0a2f3ee330f4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:48.743015 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84220b3-e9e2-490e-a873-0a2f3ee330f4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:48.743464 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84220b3-e9e2-490e-a873-0a2f3ee330f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:48.768145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b4f7-7dba-4fab-8206-9aeafa81721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:48.768846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b4f7-7dba-4fab-8206-9aeafa81721f admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:48.769129 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b4f7-7dba-4fab-8206-9aeafa81721f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:48.769386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b4f7-7dba-4fab-8206-9aeafa81721f admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:48.770059 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714b4f7-7dba-4fab-8206-9aeafa81721f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:48.787274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e84220b3-e9e2-490e-a873-0a2f3ee330f4 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:48.790510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714b4f7-7dba-4fab-8206-9aeafa81721f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:48.795607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e84220b3-e9e2-490e-a873-0a2f3ee330f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:48.825554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 697/1396] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:48.834422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84220b3-e9e2-490e-a873-0a2f3ee330f4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:48.851457 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 700/1397] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:48.861770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b4f7-7dba-4fab-8206-9aeafa81721f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:48.869014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84220b3-e9e2-490e-a873-0a2f3ee330f4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:48.879983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20239321-a5b9-44a1-9c53-9f762ff61039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:48.880814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20239321-a5b9-44a1-9c53-9f762ff61039 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:48.881233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20239321-a5b9-44a1-9c53-9f762ff61039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:48.881663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20239321-a5b9-44a1-9c53-9f762ff61039 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:48.882530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20239321-a5b9-44a1-9c53-9f762ff61039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:48.882909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20239321-a5b9-44a1-9c53-9f762ff61039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:48.887879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20239321-a5b9-44a1-9c53-9f762ff61039 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:48.889069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b4f7-7dba-4fab-8206-9aeafa81721f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:48.904031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cbf4e-04ba-4af3-9586-3bcabeb7ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:48.905411 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cbf4e-04ba-4af3-9586-3bcabeb7ee86 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:48.905702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cbf4e-04ba-4af3-9586-3bcabeb7ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:48.905979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cbf4e-04ba-4af3-9586-3bcabeb7ee86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:48.906647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cbf4e-04ba-4af3-9586-3bcabeb7ee86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:48.910843 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cbf4e-04ba-4af3-9586-3bcabeb7ee86 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:48.919909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 698/1398] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:48.926417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20239321-a5b9-44a1-9c53-9f762ff61039 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:48.933178 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 701/1399] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:48.937089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cbf4e-04ba-4af3-9586-3bcabeb7ee86 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:48.947608 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cbf4e-04ba-4af3-9586-3bcabeb7ee86 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:48.951125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20239321-a5b9-44a1-9c53-9f762ff61039 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:48.952504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cef80-0d6e-4828-9045-95135cd1b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:48.954113 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cef80-0d6e-4828-9045-95135cd1b2fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:48.954499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cef80-0d6e-4828-9045-95135cd1b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:48.956118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cef80-0d6e-4828-9045-95135cd1b2fe admin admin] PATH_INFO: `/v3/projects/04a85610093f429b8bd85f25a7ddb5cc/users/9ccbac9004204dedad44d916ed05b4b3/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:48.968075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9a569-99de-4fec-9e16-da8dd782d882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:48.968884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9a569-99de-4fec-9e16-da8dd782d882 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:48.969073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9a569-99de-4fec-9e16-da8dd782d882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:48.969348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9a569-99de-4fec-9e16-da8dd782d882 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:48.970194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9a569-99de-4fec-9e16-da8dd782d882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:48.972014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9a569-99de-4fec-9e16-da8dd782d882 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:49.015661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cef80-0d6e-4828-9045-95135cd1b2fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a85610093f429b8bd85f25a7ddb5cc, user_id=9ccbac9004204dedad44d916ed05b4b3, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:49.021829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cef80-0d6e-4828-9045-95135cd1b2fe admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:49.068837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 702/1400] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:48 2022] PUT /identity/v3/projects/04a85610093f429b8bd85f25a7ddb5cc/users/9ccbac9004204dedad44d916ed05b4b3/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:12:49.070770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aece3-7753-4bb1-8da7-ab82861a1f5c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:49.071071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aece3-7753-4bb1-8da7-ab82861a1f5c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:49.071330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aece3-7753-4bb1-8da7-ab82861a1f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:49.093972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 699/1401] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:48 2022] POST /identity/v3/projects => generated 363 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:49.096894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9a569-99de-4fec-9e16-da8dd782d882 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:49.102380 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-05c9a569-99de-4fec-9e16-da8dd782d882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:49.156003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:49.163686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-841aece3-7753-4bb1-8da7-ab82861a1f5c None None] MFA Rules not processed for user `9ccbac9004204dedad44d916ed05b4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:49.166340 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-841aece3-7753-4bb1-8da7-ab82861a1f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:49.341520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 703/1402] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:49.342404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aece3-7753-4bb1-8da7-ab82861a1f5c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:49.351703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9a569-99de-4fec-9e16-da8dd782d882 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:49.360316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83198011-97f9-4b7f-a42a-af44015414d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:49.361045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83198011-97f9-4b7f-a42a-af44015414d3 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:49.361328 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83198011-97f9-4b7f-a42a-af44015414d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:49.361599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83198011-97f9-4b7f-a42a-af44015414d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:49.364098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-83198011-97f9-4b7f-a42a-af44015414d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:49.412852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:49.452050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aece3-7753-4bb1-8da7-ab82861a1f5c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:49.459316 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c874307-3304-46dc-a185-d48567a502f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:49.460363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874307-3304-46dc-a185-d48567a502f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:49.460926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874307-3304-46dc-a185-d48567a502f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:49.461982 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874307-3304-46dc-a185-d48567a502f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:49.462991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c874307-3304-46dc-a185-d48567a502f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:49.465144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c874307-3304-46dc-a185-d48567a502f1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:49.494894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83198011-97f9-4b7f-a42a-af44015414d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:49.500597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83198011-97f9-4b7f-a42a-af44015414d3 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:49.517021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 704/1403] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:49 2022] POST /identity/v3/users => generated 282 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:49.518190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c874307-3304-46dc-a185-d48567a502f1 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:49.520348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9c874307-3304-46dc-a185-d48567a502f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:49.526276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 700/1404] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:49.527289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83198011-97f9-4b7f-a42a-af44015414d3 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:49.531531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-83198011-97f9-4b7f-a42a-af44015414d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:49.560665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83198011-97f9-4b7f-a42a-af44015414d3 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:49.571291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:49.571742 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:49.572028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:49.572326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] PATH_INFO: `/v3/projects/d06cd9f37b3148d88598121506aebdb2` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:49.573622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06cd9f37b3148d88598121506aebdb2)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:49.582607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:49.662605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c874307-3304-46dc-a185-d48567a502f1 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:49.675508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909e3f9-9cd1-4a35-960b-2e24caae0dd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:49.676150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909e3f9-9cd1-4a35-960b-2e24caae0dd6 service placement] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:49.676450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909e3f9-9cd1-4a35-960b-2e24caae0dd6 service placement] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:49.676727 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909e3f9-9cd1-4a35-960b-2e24caae0dd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:49.683040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7909e3f9-9cd1-4a35-960b-2e24caae0dd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:49.705136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909e3f9-9cd1-4a35-960b-2e24caae0dd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:49.706802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909e3f9-9cd1-4a35-960b-2e24caae0dd6 service placement] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:49.734915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06cd9f37b3148d88598121506aebdb2', 'request_id': 'req-e566f447-1674-4303-ab3d-83a0409777af'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:49.748373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 705/1405] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:49.752861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909e3f9-9cd1-4a35-960b-2e24caae0dd6 service placement] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:49.778763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909e3f9-9cd1-4a35-960b-2e24caae0dd6 service placement] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:49.783118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06cd9f37b3148d88598121506aebdb2', 'request_id': 'req-e566f447-1674-4303-ab3d-83a0409777af'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:49.798148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06cd9f37b3148d88598121506aebdb2', 'request_id': 'req-e566f447-1674-4303-ab3d-83a0409777af'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:49.829631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] The token cache is being invalidate because project d06cd9f37b3148d88598121506aebdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:12:49.829946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:49.833156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:49.835166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 701/1406] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:12:49 2022] DELETE /identity/v3/projects/d06cd9f37b3148d88598121506aebdb2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:49.836453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:49.838563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:49.927285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:49.993302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566f447-1674-4303-ab3d-83a0409777af admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:50.005426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fffa1-9be0-4ddc-8eca-fd2ad510f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:50.006763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fffa1-9be0-4ddc-8eca-fd2ad510f0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:50.007340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fffa1-9be0-4ddc-8eca-fd2ad510f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:50.008986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fffa1-9be0-4ddc-8eca-fd2ad510f0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:50.009770 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fffa1-9be0-4ddc-8eca-fd2ad510f0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:50.015702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fffa1-9be0-4ddc-8eca-fd2ad510f0c1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:50.016989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589ed21-2f12-4803-9872-5c858384519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:50.019882 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589ed21-2f12-4803-9872-5c858384519a admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:50.020280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589ed21-2f12-4803-9872-5c858384519a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:50.022737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589ed21-2f12-4803-9872-5c858384519a admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:50.025087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589ed21-2f12-4803-9872-5c858384519a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:50.030058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589ed21-2f12-4803-9872-5c858384519a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:50.079216 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 702/1407] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:50.083636 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fffa1-9be0-4ddc-8eca-fd2ad510f0c1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:50.088537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2e5fffa1-9be0-4ddc-8eca-fd2ad510f0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:50.109812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 706/1408] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:49 2022] POST /identity/v3/projects => generated 369 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:50.152627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589ed21-2f12-4803-9872-5c858384519a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:50.159034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4589ed21-2f12-4803-9872-5c858384519a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:50.376076 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:50.392785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589ed21-2f12-4803-9872-5c858384519a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:50.406096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:50.406753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:50.407026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:50.407294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] PATH_INFO: `/v3/users/e6c0ff9cbf4b4f74b3b62930d31fac9d` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:50.410933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c0ff9cbf4b4f74b3b62930d31fac9d)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:50.411772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fffa1-9be0-4ddc-8eca-fd2ad510f0c1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:50.413748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:50.553720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c0ff9cbf4b4f74b3b62930d31fac9d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:50.565707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c0ff9cbf4b4f74b3b62930d31fac9d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:50.566959 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c0ff9cbf4b4f74b3b62930d31fac9d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:50.600362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c0ff9cbf4b4f74b3b62930d31fac9d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:50.601299 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c0ff9cbf4b4f74b3b62930d31fac9d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:50.623083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec057c7-3ecc-4434-bfaa-75d8e2c86bf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:50.624859 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec057c7-3ecc-4434-bfaa-75d8e2c86bf1 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:50.625351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec057c7-3ecc-4434-bfaa-75d8e2c86bf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:50.625792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec057c7-3ecc-4434-bfaa-75d8e2c86bf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:50.629890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7ec057c7-3ecc-4434-bfaa-75d8e2c86bf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:50.636427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 707/1409] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:12:50 2022] DELETE /identity/v3/users/e6c0ff9cbf4b4f74b3b62930d31fac9d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:50.652674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:50.658030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:50.798624 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec057c7-3ecc-4434-bfaa-75d8e2c86bf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:50.800416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec057c7-3ecc-4434-bfaa-75d8e2c86bf1 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:50.822299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 703/1410] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:50.823143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec057c7-3ecc-4434-bfaa-75d8e2c86bf1 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:50.829508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7ec057c7-3ecc-4434-bfaa-75d8e2c86bf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:50.850237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:50.854971 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935a1a4-ca7c-4f4a-b94f-f0b84bc7d906 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:50.864848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da2087-4f7d-4ffe-8299-bca3bde27519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:50.865571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da2087-4f7d-4ffe-8299-bca3bde27519 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:50.865960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da2087-4f7d-4ffe-8299-bca3bde27519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:50.866341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da2087-4f7d-4ffe-8299-bca3bde27519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:50.869301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da2087-4f7d-4ffe-8299-bca3bde27519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:50.871264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da2087-4f7d-4ffe-8299-bca3bde27519 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:50.871374 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec057c7-3ecc-4434-bfaa-75d8e2c86bf1 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:50.884664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 708/1411] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:50.887620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f003ea-291c-4c7c-bc69-95f89ca84c61 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:50.888070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f003ea-291c-4c7c-bc69-95f89ca84c61 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:50.888527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f003ea-291c-4c7c-bc69-95f89ca84c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:50.908583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acecf6e-6221-4499-8d68-05bdff2c06e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:50.910749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acecf6e-6221-4499-8d68-05bdff2c06e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:50.911743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acecf6e-6221-4499-8d68-05bdff2c06e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:50.913104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acecf6e-6221-4499-8d68-05bdff2c06e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:50.913979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acecf6e-6221-4499-8d68-05bdff2c06e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:50.922513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acecf6e-6221-4499-8d68-05bdff2c06e3 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:50.952906 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-71f003ea-291c-4c7c-bc69-95f89ca84c61 None None] MFA Rules not processed for user `0b96ce275ce04db9b46265361e06a483`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:50.955096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-71f003ea-291c-4c7c-bc69-95f89ca84c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:51.012702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 704/1412] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:50 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:51.014457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acecf6e-6221-4499-8d68-05bdff2c06e3 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:51.028766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acecf6e-6221-4499-8d68-05bdff2c06e3 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:51.039460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835b05a-25c4-4ed3-bbf1-74150b389fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:51.041187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835b05a-25c4-4ed3-bbf1-74150b389fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:51.041617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835b05a-25c4-4ed3-bbf1-74150b389fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:51.042215 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835b05a-25c4-4ed3-bbf1-74150b389fb7 admin admin] PATH_INFO: `/v3/projects/44ad05338fed4f73b271d927cdd2bf02/users/57837e98f4044b14841c805faa5b4d08/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:51.072910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835b05a-25c4-4ed3-bbf1-74150b389fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ad05338fed4f73b271d927cdd2bf02, user_id=57837e98f4044b14841c805faa5b4d08, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:51.082558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835b05a-25c4-4ed3-bbf1-74150b389fb7 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:51.094961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 709/1413] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:51.096063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f003ea-291c-4c7c-bc69-95f89ca84c61 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:51.110610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f003ea-291c-4c7c-bc69-95f89ca84c61 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:51.120343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 705/1414] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:51 2022] PUT /identity/v3/projects/44ad05338fed4f73b271d927cdd2bf02/users/57837e98f4044b14841c805faa5b4d08/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:51.130494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b41ee-da7c-4ac2-9835-fcb3a2013bd8 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:51.130786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b41ee-da7c-4ac2-9835-fcb3a2013bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:51.131259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b41ee-da7c-4ac2-9835-fcb3a2013bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:51.164054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:51.220839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ad6b41ee-da7c-4ac2-9835-fcb3a2013bd8 None None] MFA Rules not processed for user `57837e98f4044b14841c805faa5b4d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:51.225290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ad6b41ee-da7c-4ac2-9835-fcb3a2013bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:51.273701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee853585-12d4-4fcb-946c-bd8ea1d0f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:51.273701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee853585-12d4-4fcb-946c-bd8ea1d0f475 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:51.273701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee853585-12d4-4fcb-946c-bd8ea1d0f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:51.274086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee853585-12d4-4fcb-946c-bd8ea1d0f475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:51.274459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee853585-12d4-4fcb-946c-bd8ea1d0f475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:51.276319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee853585-12d4-4fcb-946c-bd8ea1d0f475 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:51.300558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 710/1415] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:51.304537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee853585-12d4-4fcb-946c-bd8ea1d0f475 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:51.326825 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee853585-12d4-4fcb-946c-bd8ea1d0f475 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:51.342428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aa8f3-1171-44a0-a955-8deba498e269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:51.344011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aa8f3-1171-44a0-a955-8deba498e269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:51.344011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aa8f3-1171-44a0-a955-8deba498e269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:51.344266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aa8f3-1171-44a0-a955-8deba498e269 admin admin] PATH_INFO: `/v3/projects/040260dcb87a455082b78ca30372f9a2/users/b6483c32a5e44a649b754c16e26610b2/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:51.386986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aa8f3-1171-44a0-a955-8deba498e269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040260dcb87a455082b78ca30372f9a2, user_id=b6483c32a5e44a649b754c16e26610b2, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:51.390464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aa8f3-1171-44a0-a955-8deba498e269 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:51.421745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 711/1416] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:51 2022] PUT /identity/v3/projects/040260dcb87a455082b78ca30372f9a2/users/b6483c32a5e44a649b754c16e26610b2/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:51.422795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aa8f3-1171-44a0-a955-8deba498e269 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:51.424199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 706/1417] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:12:51.426263 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b41ee-da7c-4ac2-9835-fcb3a2013bd8 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:51.428966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-841aa8f3-1171-44a0-a955-8deba498e269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:51.448177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b41ee-da7c-4ac2-9835-fcb3a2013bd8 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:51.551046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016027e-a215-47f9-9cfe-b8a8927f4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:51.552227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016027e-a215-47f9-9cfe-b8a8927f4a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:51.552673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016027e-a215-47f9-9cfe-b8a8927f4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:51.553073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016027e-a215-47f9-9cfe-b8a8927f4a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:51.553928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016027e-a215-47f9-9cfe-b8a8927f4a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:51.555957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016027e-a215-47f9-9cfe-b8a8927f4a81 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:51.569707 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 707/1418] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:12:51.571373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016027e-a215-47f9-9cfe-b8a8927f4a81 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:51.588689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aa8f3-1171-44a0-a955-8deba498e269 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:51.599663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016027e-a215-47f9-9cfe-b8a8927f4a81 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:51.612780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:51.616238 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:51.622142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:51.622142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] PATH_INFO: `/v3/users/1ea71118fe4440d18ce48d3418283c65` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:51.624264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea71118fe4440d18ce48d3418283c65)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:51.635721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:51.636885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12d1e-abdf-448c-9411-2e1c7a2b0663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:51.638501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12d1e-abdf-448c-9411-2e1c7a2b0663 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:51.638999 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12d1e-abdf-448c-9411-2e1c7a2b0663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:51.639328 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12d1e-abdf-448c-9411-2e1c7a2b0663 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:51.639999 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c12d1e-abdf-448c-9411-2e1c7a2b0663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:51.646870 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c12d1e-abdf-448c-9411-2e1c7a2b0663 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:51.713925 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 708/1419] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:51 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:51.718895 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12d1e-abdf-448c-9411-2e1c7a2b0663 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:51.837328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea71118fe4440d18ce48d3418283c65'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:51.856596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:51.865352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea71118fe4440d18ce48d3418283c65'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:51.868868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea71118fe4440d18ce48d3418283c65'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:51.924599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea71118fe4440d18ce48d3418283c65'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:51.929598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea71118fe4440d18ce48d3418283c65'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:51.959889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 712/1420] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:12:51 2022] DELETE /identity/v3/users/1ea71118fe4440d18ce48d3418283c65 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:51.962117 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:51.963911 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:52.022921 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12d1e-abdf-448c-9411-2e1c7a2b0663 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:52.024953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:52.137305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9d6ed-ef7e-4ce6-bde8-a2029e855c80 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:52.142489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9803e-0d50-4983-9f0d-17a18ab4a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:52.143383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9803e-0d50-4983-9f0d-17a18ab4a90f admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:52.143937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9803e-0d50-4983-9f0d-17a18ab4a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:52.144345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9803e-0d50-4983-9f0d-17a18ab4a90f admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:52.145096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9803e-0d50-4983-9f0d-17a18ab4a90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:52.147297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9803e-0d50-4983-9f0d-17a18ab4a90f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:52.179286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 713/1421] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:51 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:52.184159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786f0fb-41b0-45ed-b03c-4d30b4db203e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:52.187517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786f0fb-41b0-45ed-b03c-4d30b4db203e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:52.188434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786f0fb-41b0-45ed-b03c-4d30b4db203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:52.235014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c166e-b9d1-479b-ae90-c9d03a35d705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:52.235709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c166e-b9d1-479b-ae90-c9d03a35d705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:52.236166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c166e-b9d1-479b-ae90-c9d03a35d705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:52.236479 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c166e-b9d1-479b-ae90-c9d03a35d705 admin admin] PATH_INFO: `/v3/projects/040260dcb87a455082b78ca30372f9a2/users/b6483c32a5e44a649b754c16e26610b2/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:52.244169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c166e-b9d1-479b-ae90-c9d03a35d705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040260dcb87a455082b78ca30372f9a2, user_id=b6483c32a5e44a649b754c16e26610b2, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:52.247003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c166e-b9d1-479b-ae90-c9d03a35d705 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:52.261525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-7786f0fb-41b0-45ed-b03c-4d30b4db203e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:52.267079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7786f0fb-41b0-45ed-b03c-4d30b4db203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:52.273389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 709/1422] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:51 2022] PUT /identity/v3/projects/040260dcb87a455082b78ca30372f9a2/users/b6483c32a5e44a649b754c16e26610b2/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:52.276436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c166e-b9d1-479b-ae90-c9d03a35d705 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:52.490298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 714/1423] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:52.491312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786f0fb-41b0-45ed-b03c-4d30b4db203e None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:52.502433 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7786f0fb-41b0-45ed-b03c-4d30b4db203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:52.515235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c166e-b9d1-479b-ae90-c9d03a35d705 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:52.524821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb7bf1-05ac-4bb5-897d-49cfe5994b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:52.525663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb7bf1-05ac-4bb5-897d-49cfe5994b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:52.544080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb7bf1-05ac-4bb5-897d-49cfe5994b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:52.545167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb7bf1-05ac-4bb5-897d-49cfe5994b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:52.546044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb7bf1-05ac-4bb5-897d-49cfe5994b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:52.547716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb7bf1-05ac-4bb5-897d-49cfe5994b8f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:52.549938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786f0fb-41b0-45ed-b03c-4d30b4db203e None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:52.567206 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 710/1424] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:52.568714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd088fd-c2ba-4494-8082-cc37e692937a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:52.569013 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd088fd-c2ba-4494-8082-cc37e692937a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:52.569292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd088fd-c2ba-4494-8082-cc37e692937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:52.589208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:52.591014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:52.597052 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:52.599202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] PATH_INFO: `/v3/projects/d4a551aecde842809bf8c4d0085b6f94` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:52.603610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a551aecde842809bf8c4d0085b6f94)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:52.618539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:52.632004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-fcd088fd-c2ba-4494-8082-cc37e692937a None None] MFA Rules not processed for user `b6483c32a5e44a649b754c16e26610b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:52.634417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fcd088fd-c2ba-4494-8082-cc37e692937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:52.772612 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:52.806909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 711/1425] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:52.806909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd088fd-c2ba-4494-8082-cc37e692937a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:52.809480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fcd088fd-c2ba-4494-8082-cc37e692937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:52.829180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a551aecde842809bf8c4d0085b6f94', 'request_id': 'req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:52.848705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a551aecde842809bf8c4d0085b6f94', 'request_id': 'req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:52.864002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a551aecde842809bf8c4d0085b6f94', 'request_id': 'req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:52.891704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] The token cache is being invalidate because project d4a551aecde842809bf8c4d0085b6f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:12:52.892039 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:52.893186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:52.895724 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 715/1426] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:12:52 2022] DELETE /identity/v3/projects/d4a551aecde842809bf8c4d0085b6f94 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:52.896684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:52.901759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:53.007654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:53.009161 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd088fd-c2ba-4494-8082-cc37e692937a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:53.122708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208b76b-7178-48b0-b1dc-a0bf99bfe0e7 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:53.136668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59c9d-739b-4b20-a88b-40e20dc892e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:53.137464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59c9d-739b-4b20-a88b-40e20dc892e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:53.138220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59c9d-739b-4b20-a88b-40e20dc892e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:53.138220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59c9d-739b-4b20-a88b-40e20dc892e9 admin admin] PATH_INFO: `/v3/projects/30400678c83b4c4c8c583dfebcf865d6/users/1e15c4bd5c514f14bc9216f76cf27905/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:53.160353 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c9105-bcf4-4235-a8da-e31cc7cb14b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:53.161374 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c9105-bcf4-4235-a8da-e31cc7cb14b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:53.162109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c9105-bcf4-4235-a8da-e31cc7cb14b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:53.164030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c9105-bcf4-4235-a8da-e31cc7cb14b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:53.167797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-468c9105-bcf4-4235-a8da-e31cc7cb14b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:53.175596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a59c9d-739b-4b20-a88b-40e20dc892e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30400678c83b4c4c8c583dfebcf865d6, user_id=1e15c4bd5c514f14bc9216f76cf27905, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:53.181961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a59c9d-739b-4b20-a88b-40e20dc892e9 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:53.197357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c9105-bcf4-4235-a8da-e31cc7cb14b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:53.204308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c9105-bcf4-4235-a8da-e31cc7cb14b4 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:53.230137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 716/1427] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:52 2022] PUT /identity/v3/projects/30400678c83b4c4c8c583dfebcf865d6/users/1e15c4bd5c514f14bc9216f76cf27905/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:53.235609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59c9d-739b-4b20-a88b-40e20dc892e9 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:53.242307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-43a59c9d-739b-4b20-a88b-40e20dc892e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:53.265719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 712/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:53.271033 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca1c2-583e-4ac7-9eed-e9ca530f40cc None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:53.272210 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca1c2-583e-4ac7-9eed-e9ca530f40cc None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:53.273320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca1c2-583e-4ac7-9eed-e9ca530f40cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:53.344938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c4bca1c2-583e-4ac7-9eed-e9ca530f40cc None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:53.348411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c4bca1c2-583e-4ac7-9eed-e9ca530f40cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:53.517219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59c9d-739b-4b20-a88b-40e20dc892e9 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:53.538401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b3632-47da-45aa-ad1e-9f19914133a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:53.539258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b3632-47da-45aa-ad1e-9f19914133a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:53.540874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b3632-47da-45aa-ad1e-9f19914133a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:53.541276 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b3632-47da-45aa-ad1e-9f19914133a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:53.547736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-953b3632-47da-45aa-ad1e-9f19914133a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:53.588620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 713/1429] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:53.589564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bca1c2-583e-4ac7-9eed-e9ca530f40cc None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:53.609137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bca1c2-583e-4ac7-9eed-e9ca530f40cc None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:53.622373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a1394-6b2a-4a60-a809-cb16c7c46780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:53.623015 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a1394-6b2a-4a60-a809-cb16c7c46780 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:53.623298 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a1394-6b2a-4a60-a809-cb16c7c46780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:53.623564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a1394-6b2a-4a60-a809-cb16c7c46780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:53.624214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a1394-6b2a-4a60-a809-cb16c7c46780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:53.629586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a1394-6b2a-4a60-a809-cb16c7c46780 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:53.652665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 714/1430] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:53.654110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c86114-235a-429a-8b87-c49e681b5fba None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:53.654395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c86114-235a-429a-8b87-c49e681b5fba None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:53.656082 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c86114-235a-429a-8b87-c49e681b5fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:53.697529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-02c86114-235a-429a-8b87-c49e681b5fba None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:53.699005 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-02c86114-235a-429a-8b87-c49e681b5fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:53.721986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 715/1431] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:53.721986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c86114-235a-429a-8b87-c49e681b5fba None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:53.730326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b3632-47da-45aa-ad1e-9f19914133a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:53.731919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b3632-47da-45aa-ad1e-9f19914133a9 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:53.745669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 717/1432] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:53.746615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b3632-47da-45aa-ad1e-9f19914133a9 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:53.747573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c86114-235a-429a-8b87-c49e681b5fba None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:53.759648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b3632-47da-45aa-ad1e-9f19914133a9 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:53.760566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaa14a-07ea-4057-b219-b848ffdf114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:53.761448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa14a-07ea-4057-b219-b848ffdf114f admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:53.761895 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa14a-07ea-4057-b219-b848ffdf114f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:53.762526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa14a-07ea-4057-b219-b848ffdf114f admin admin] PATH_INFO: `/v3/projects/30400678c83b4c4c8c583dfebcf865d6/users/1e15c4bd5c514f14bc9216f76cf27905/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:53.765884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f88b0-07d6-443a-b040-5ee0ca257786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:53.766036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaa14a-07ea-4057-b219-b848ffdf114f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30400678c83b4c4c8c583dfebcf865d6, user_id=1e15c4bd5c514f14bc9216f76cf27905, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:53.766636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f88b0-07d6-443a-b040-5ee0ca257786 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:53.766919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f88b0-07d6-443a-b040-5ee0ca257786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:53.767286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f88b0-07d6-443a-b040-5ee0ca257786 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:53.768057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f88b0-07d6-443a-b040-5ee0ca257786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:12:53.768502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f88b0-07d6-443a-b040-5ee0ca257786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:53.769820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaa14a-07ea-4057-b219-b848ffdf114f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:53.770427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f88b0-07d6-443a-b040-5ee0ca257786 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:53.786590 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 718/1433] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:12:53.790983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f88b0-07d6-443a-b040-5ee0ca257786 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:53.807575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 716/1434] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:53 2022] PUT /identity/v3/projects/30400678c83b4c4c8c583dfebcf865d6/users/1e15c4bd5c514f14bc9216f76cf27905/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:53.822810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57923ce5-4bc6-456e-a056-a3753530aefc None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:53.823198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57923ce5-4bc6-456e-a056-a3753530aefc None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:53.823842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57923ce5-4bc6-456e-a056-a3753530aefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:53.862437 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f88b0-07d6-443a-b040-5ee0ca257786 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:53.879460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-57923ce5-4bc6-456e-a056-a3753530aefc None None] MFA Rules not processed for user `1e15c4bd5c514f14bc9216f76cf27905`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:53.882193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-57923ce5-4bc6-456e-a056-a3753530aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:53.893390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:54.024905 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:54.060193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 717/1435] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:54.062612 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57923ce5-4bc6-456e-a056-a3753530aefc None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:54.077297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f4bfd-22d7-47e1-a72a-cc053f35ef47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:54.077934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f4bfd-22d7-47e1-a72a-cc053f35ef47 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:54.078213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f4bfd-22d7-47e1-a72a-cc053f35ef47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:54.078488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f4bfd-22d7-47e1-a72a-cc053f35ef47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:54.079843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-57923ce5-4bc6-456e-a056-a3753530aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:54.080572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f4bfd-22d7-47e1-a72a-cc053f35ef47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:54.096949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f4bfd-22d7-47e1-a72a-cc053f35ef47 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:54.198791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 719/1436] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:53 2022] POST /identity/v3/projects => generated 367 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:54.199768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f4bfd-22d7-47e1-a72a-cc053f35ef47 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:54.304574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57923ce5-4bc6-456e-a056-a3753530aefc None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:54.348834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f4bfd-22d7-47e1-a72a-cc053f35ef47 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:54.360499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d17fae-1473-4260-b74d-be826bafaafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:54.361314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d17fae-1473-4260-b74d-be826bafaafb service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:54.361598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d17fae-1473-4260-b74d-be826bafaafb service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:54.362069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d17fae-1473-4260-b74d-be826bafaafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:54.433719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7144045-6455-413d-a5fd-43959d5d7f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:54.436575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7144045-6455-413d-a5fd-43959d5d7f44 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:54.436834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7144045-6455-413d-a5fd-43959d5d7f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:54.437122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7144045-6455-413d-a5fd-43959d5d7f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:54.442281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b7144045-6455-413d-a5fd-43959d5d7f44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:54.586997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d17fae-1473-4260-b74d-be826bafaafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:54.597910 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d17fae-1473-4260-b74d-be826bafaafb service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:54.637327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 720/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:54.638797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d17fae-1473-4260-b74d-be826bafaafb service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:54.699211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7144045-6455-413d-a5fd-43959d5d7f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:54.704419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7144045-6455-413d-a5fd-43959d5d7f44 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:54.729846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 718/1438] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:54.731188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f88d8b-6246-48c6-bc2d-83125d712dce None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:54.731468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f88d8b-6246-48c6-bc2d-83125d712dce None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:54.731748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f88d8b-6246-48c6-bc2d-83125d712dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:54.780906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:54.838528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d17fae-1473-4260-b74d-be826bafaafb service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:54.845831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdae648-38c9-466a-bcf2-334f935578ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:54.846336 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae648-38c9-466a-bcf2-334f935578ac admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:54.852526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae648-38c9-466a-bcf2-334f935578ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:54.852883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae648-38c9-466a-bcf2-334f935578ac admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:54.853575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdae648-38c9-466a-bcf2-334f935578ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:54.855554 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdae648-38c9-466a-bcf2-334f935578ac admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:54.876784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-45f88d8b-6246-48c6-bc2d-83125d712dce None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:54.877974 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-45f88d8b-6246-48c6-bc2d-83125d712dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:54.939052 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 721/1439] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:54 2022] POST /identity/v3/users => generated 284 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:12:54.940587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f93502-94f5-4250-b247-0fa63c4d8d69 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:54.940876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f93502-94f5-4250-b247-0fa63c4d8d69 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:54.941205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f93502-94f5-4250-b247-0fa63c4d8d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:54.967409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:54.978243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-77f93502-94f5-4250-b247-0fa63c4d8d69 None None] MFA Rules not processed for user `8d4c78fc725b440eb266b0365cbfcedd`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:54.979561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-77f93502-94f5-4250-b247-0fa63c4d8d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:55.056336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 719/1440] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:55.057355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f88d8b-6246-48c6-bc2d-83125d712dce None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:55.081088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f88d8b-6246-48c6-bc2d-83125d712dce None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:55.092182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815e15a-25c6-454a-b4f5-1e0679ee59db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:55.093108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815e15a-25c6-454a-b4f5-1e0679ee59db service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:55.093527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815e15a-25c6-454a-b4f5-1e0679ee59db service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:55.093821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815e15a-25c6-454a-b4f5-1e0679ee59db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:55.098633 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c815e15a-25c6-454a-b4f5-1e0679ee59db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:55.125634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 722/1441] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:55.126674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f93502-94f5-4250-b247-0fa63c4d8d69 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:55.153302 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-77f93502-94f5-4250-b247-0fa63c4d8d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:55.205589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f93502-94f5-4250-b247-0fa63c4d8d69 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:55.225853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:55.226515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:55.226853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:55.227128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] PATH_INFO: `/v3/projects/094bef039354476b93e57c12446706a4` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:55.228341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094bef039354476b93e57c12446706a4)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:55.230289 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:55.319508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815e15a-25c6-454a-b4f5-1e0679ee59db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:55.323097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815e15a-25c6-454a-b4f5-1e0679ee59db service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:55.348236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 720/1442] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:55.350319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815e15a-25c6-454a-b4f5-1e0679ee59db service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:55.378748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815e15a-25c6-454a-b4f5-1e0679ee59db service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:55.405446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094bef039354476b93e57c12446706a4', 'request_id': 'req-931c8061-32f3-4098-b0e5-710805a123b5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:55.421309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094bef039354476b93e57c12446706a4', 'request_id': 'req-931c8061-32f3-4098-b0e5-710805a123b5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:55.431214 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094bef039354476b93e57c12446706a4', 'request_id': 'req-931c8061-32f3-4098-b0e5-710805a123b5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:55.466128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] The token cache is being invalidate because project 094bef039354476b93e57c12446706a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:12:55.467860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:55.469601 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:55.476172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 723/1443] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:12:55 2022] DELETE /identity/v3/projects/094bef039354476b93e57c12446706a4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:55.478928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:55.486230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:55.558801 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e219f3a-02bb-47fc-b589-a355907bb7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:55.560524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e219f3a-02bb-47fc-b589-a355907bb7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:55.560879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e219f3a-02bb-47fc-b589-a355907bb7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:55.562540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e219f3a-02bb-47fc-b589-a355907bb7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:55.564387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e219f3a-02bb-47fc-b589-a355907bb7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:55.570665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e219f3a-02bb-47fc-b589-a355907bb7a8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:55.599997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 721/1444] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:55.602703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e219f3a-02bb-47fc-b589-a355907bb7a8 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:55.606580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0e219f3a-02bb-47fc-b589-a355907bb7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:55.643637 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e219f3a-02bb-47fc-b589-a355907bb7a8 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:55.656206 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:55.658389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:55.658796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:55.659193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] PATH_INFO: `/v3/users/7357a9e9460c47be842ae26995255b20` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:55.662793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7357a9e9460c47be842ae26995255b20)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:55.668911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:55.707963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:55.827185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7357a9e9460c47be842ae26995255b20'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:55.837942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7357a9e9460c47be842ae26995255b20'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:55.849600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c8061-32f3-4098-b0e5-710805a123b5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:55.856416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7357a9e9460c47be842ae26995255b20'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:55.857268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7357a9e9460c47be842ae26995255b20'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:55.857988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7357a9e9460c47be842ae26995255b20'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:12:55.865216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442495e5-e183-4968-9430-867d65ea7c6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:55.866415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442495e5-e183-4968-9430-867d65ea7c6f service swift] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:55.867433 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442495e5-e183-4968-9430-867d65ea7c6f service swift] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:55.867935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442495e5-e183-4968-9430-867d65ea7c6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:55.870442 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-442495e5-e183-4968-9430-867d65ea7c6f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:55.887438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 722/1445] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:12:55 2022] DELETE /identity/v3/users/7357a9e9460c47be842ae26995255b20 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:55.892752 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:55.897573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:55.909324 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:56.033310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1937-c9c8-410f-babd-8829bac181f4 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:56.035667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442495e5-e183-4968-9430-867d65ea7c6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:56.041887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16584-6cc8-4a6d-92c3-ef45c043ae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:56.042653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16584-6cc8-4a6d-92c3-ef45c043ae80 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:56.042940 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16584-6cc8-4a6d-92c3-ef45c043ae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:56.043397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16584-6cc8-4a6d-92c3-ef45c043ae80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:56.043500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442495e5-e183-4968-9430-867d65ea7c6f service swift] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:56.044120 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e16584-6cc8-4a6d-92c3-ef45c043ae80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:56.047389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e16584-6cc8-4a6d-92c3-ef45c043ae80 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:56.066495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 723/1446] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:56.071046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16584-6cc8-4a6d-92c3-ef45c043ae80 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:56.074458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 724/1447] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:12:56.084368 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16584-6cc8-4a6d-92c3-ef45c043ae80 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:56.091866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226b42e-b7c1-4a87-84af-cdc049fb28c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:56.092732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226b42e-b7c1-4a87-84af-cdc049fb28c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:56.093316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226b42e-b7c1-4a87-84af-cdc049fb28c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:56.093689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226b42e-b7c1-4a87-84af-cdc049fb28c9 admin admin] PATH_INFO: `/v3/projects/e1e454e45bfc4ef484bbf989bcd36803/users/030f1ad00f854e70977c2a11098a1769/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:56.117580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226b42e-b7c1-4a87-84af-cdc049fb28c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e454e45bfc4ef484bbf989bcd36803, user_id=030f1ad00f854e70977c2a11098a1769, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:56.124112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226b42e-b7c1-4a87-84af-cdc049fb28c9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:56.159993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 724/1448] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:56 2022] PUT /identity/v3/projects/e1e454e45bfc4ef484bbf989bcd36803/users/030f1ad00f854e70977c2a11098a1769/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:56.170577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940024ef-94d9-42d7-8172-25ec368632f8 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:56.170944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940024ef-94d9-42d7-8172-25ec368632f8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:56.171137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940024ef-94d9-42d7-8172-25ec368632f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:56.326967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-940024ef-94d9-42d7-8172-25ec368632f8 None None] MFA Rules not processed for user `030f1ad00f854e70977c2a11098a1769`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:56.328225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-940024ef-94d9-42d7-8172-25ec368632f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:56.673300 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 725/1449] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:56.674201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226b42e-b7c1-4a87-84af-cdc049fb28c9 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:56.948642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226b42e-b7c1-4a87-84af-cdc049fb28c9 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:56.994461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da8da9-538a-4458-b9dc-d519d5b44ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:56.995244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da8da9-538a-4458-b9dc-d519d5b44ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:56.995522 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da8da9-538a-4458-b9dc-d519d5b44ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:56.995786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da8da9-538a-4458-b9dc-d519d5b44ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:56.996477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da8da9-538a-4458-b9dc-d519d5b44ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:56.998441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da8da9-538a-4458-b9dc-d519d5b44ad1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:57.051981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:57.146898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940024ef-94d9-42d7-8172-25ec368632f8 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:57.150373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 725/1450] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:12:56 2022] POST /identity/v3/projects => generated 363 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:12:57.167627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940024ef-94d9-42d7-8172-25ec368632f8 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:57.399992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15667caa-e4c0-4ff4-8813-84696b59d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:57.400638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667caa-e4c0-4ff4-8813-84696b59d724 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:57.400923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667caa-e4c0-4ff4-8813-84696b59d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:57.401199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667caa-e4c0-4ff4-8813-84696b59d724 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:57.401848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15667caa-e4c0-4ff4-8813-84696b59d724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:57.403823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15667caa-e4c0-4ff4-8813-84696b59d724 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:57.494754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 726/1451] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:12:57 2022] POST /identity/v3/users => generated 288 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:12:57.497857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da8da9-538a-4458-b9dc-d519d5b44ad1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:57.521154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da8da9-538a-4458-b9dc-d519d5b44ad1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:57.550334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042a84e-0eab-46ec-bd38-de3104915210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:57.550953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a84e-0eab-46ec-bd38-de3104915210 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:57.550953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a84e-0eab-46ec-bd38-de3104915210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:57.551987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a84e-0eab-46ec-bd38-de3104915210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:57.551987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042a84e-0eab-46ec-bd38-de3104915210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:57.553746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042a84e-0eab-46ec-bd38-de3104915210 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:57.613683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 726/1452] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:57.618305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15667caa-e4c0-4ff4-8813-84696b59d724 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:57.636931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15667caa-e4c0-4ff4-8813-84696b59d724 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:57.657100 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e70a-61ca-48cf-b41b-83b242978350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:57.657808 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e70a-61ca-48cf-b41b-83b242978350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:57.658086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e70a-61ca-48cf-b41b-83b242978350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:57.658359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e70a-61ca-48cf-b41b-83b242978350 admin admin] PATH_INFO: `/v3/projects/976c4925664a44639b917f7a73efb2af/users/1f1a748c2a234c5b96d16b9ce2e7c2d0/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:57.758156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82e70a-61ca-48cf-b41b-83b242978350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976c4925664a44639b917f7a73efb2af, user_id=1f1a748c2a234c5b96d16b9ce2e7c2d0, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:57.773038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82e70a-61ca-48cf-b41b-83b242978350 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:57.837711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 727/1453] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:57 2022] PUT /identity/v3/projects/976c4925664a44639b917f7a73efb2af/users/1f1a748c2a234c5b96d16b9ce2e7c2d0/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:57.841733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042a84e-0eab-46ec-bd38-de3104915210 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:57.859284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042a84e-0eab-46ec-bd38-de3104915210 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:58.059918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27574-113d-4a0f-8a1e-240fcdf08d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:58.060753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27574-113d-4a0f-8a1e-240fcdf08d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:58.061098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27574-113d-4a0f-8a1e-240fcdf08d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:58.061436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27574-113d-4a0f-8a1e-240fcdf08d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:58.062239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27574-113d-4a0f-8a1e-240fcdf08d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:58.066610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27574-113d-4a0f-8a1e-240fcdf08d2f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:58.097302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 727/1454] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:12:58.100165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e70a-61ca-48cf-b41b-83b242978350 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:58.115460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e70a-61ca-48cf-b41b-83b242978350 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:58.146114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367167-c68e-4ee4-89b2-744248b6bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:58.147266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367167-c68e-4ee4-89b2-744248b6bea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:58.147266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367167-c68e-4ee4-89b2-744248b6bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:58.148652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367167-c68e-4ee4-89b2-744248b6bea8 admin admin] PATH_INFO: `/v3/projects/976c4925664a44639b917f7a73efb2af/users/1f1a748c2a234c5b96d16b9ce2e7c2d0/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:58.156719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367167-c68e-4ee4-89b2-744248b6bea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976c4925664a44639b917f7a73efb2af, user_id=1f1a748c2a234c5b96d16b9ce2e7c2d0, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:58.163632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a367167-c68e-4ee4-89b2-744248b6bea8 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:58.187647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:58.204532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 728/1455] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:12:58 2022] PUT /identity/v3/projects/976c4925664a44639b917f7a73efb2af/users/1f1a748c2a234c5b96d16b9ce2e7c2d0/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:12:58.216934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37138f59-0384-4266-8e60-923a661528b9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:58.217292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37138f59-0384-4266-8e60-923a661528b9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:58.217635 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37138f59-0384-4266-8e60-923a661528b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:58.270238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-37138f59-0384-4266-8e60-923a661528b9 None None] MFA Rules not processed for user `1f1a748c2a234c5b96d16b9ce2e7c2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:58.271766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-37138f59-0384-4266-8e60-923a661528b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:58.479996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 728/1456] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:58.490749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367167-c68e-4ee4-89b2-744248b6bea8 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:58.493288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6a367167-c68e-4ee4-89b2-744248b6bea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:58.688638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367167-c68e-4ee4-89b2-744248b6bea8 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:58.699203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c061b9-2c5d-49d8-9b78-9cc43aebc206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:58.700035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c061b9-2c5d-49d8-9b78-9cc43aebc206 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:58.700344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c061b9-2c5d-49d8-9b78-9cc43aebc206 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:58.700939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c061b9-2c5d-49d8-9b78-9cc43aebc206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:58.728204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c061b9-2c5d-49d8-9b78-9cc43aebc206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:58.730075 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c061b9-2c5d-49d8-9b78-9cc43aebc206 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:58.755895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 729/1457] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:58.887028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8e36-e66d-4f67-9ad9-d359e451fd4c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:58.887816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8e36-e66d-4f67-9ad9-d359e451fd4c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:58.888426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8e36-e66d-4f67-9ad9-d359e451fd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:58.915020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c061b9-2c5d-49d8-9b78-9cc43aebc206 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:58.935059 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c061b9-2c5d-49d8-9b78-9cc43aebc206 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:58.956667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d29eb-724b-4e1a-8dad-37a084c8dfd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:58.960928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d29eb-724b-4e1a-8dad-37a084c8dfd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:58.961684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d29eb-724b-4e1a-8dad-37a084c8dfd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:58.964147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d29eb-724b-4e1a-8dad-37a084c8dfd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:58.985462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e56b8e36-e66d-4f67-9ad9-d359e451fd4c None None] MFA Rules not processed for user `974f2acdadf14df69cbe33351ee02a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:12:58.989240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e56b8e36-e66d-4f67-9ad9-d359e451fd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:59.131679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d29eb-724b-4e1a-8dad-37a084c8dfd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:59.134968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d29eb-724b-4e1a-8dad-37a084c8dfd9 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:59.172384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 730/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:12:59.181904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 729/1459] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Oct 24 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:12:59.233178 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d29eb-724b-4e1a-8dad-37a084c8dfd9 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:12:59.236009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8c9d29eb-724b-4e1a-8dad-37a084c8dfd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:12:59.274680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d29eb-724b-4e1a-8dad-37a084c8dfd9 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:12:59.287589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597dd2e-685d-4375-b98e-67a192e07b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:12:59.288233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597dd2e-685d-4375-b98e-67a192e07b8b service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:12:59.288539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597dd2e-685d-4375-b98e-67a192e07b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:12:59.288832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597dd2e-685d-4375-b98e-67a192e07b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:12:59.324193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597dd2e-685d-4375-b98e-67a192e07b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:12:59.325696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597dd2e-685d-4375-b98e-67a192e07b8b service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:12:59.367294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 731/1460] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:12:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:00.062157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b8e36-e66d-4f67-9ad9-d359e451fd4c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:00.063882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e56b8e36-e66d-4f67-9ad9-d359e451fd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:00.125434 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:00.313932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b8e36-e66d-4f67-9ad9-d359e451fd4c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:00.329903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:00.333334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:00.333643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:00.333928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] PATH_INFO: `/v3/projects/57aea106904c4acf8b5535cb0295878a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:00.338347 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57aea106904c4acf8b5535cb0295878a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:00.361426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:00.612176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57aea106904c4acf8b5535cb0295878a', 'request_id': 'req-ea66071f-4441-4666-9495-8a5ee6882a03'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:00.628814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57aea106904c4acf8b5535cb0295878a', 'request_id': 'req-ea66071f-4441-4666-9495-8a5ee6882a03'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:00.655094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57aea106904c4acf8b5535cb0295878a', 'request_id': 'req-ea66071f-4441-4666-9495-8a5ee6882a03'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:00.686740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] The token cache is being invalidate because project 57aea106904c4acf8b5535cb0295878a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:00.688460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:00.691529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ea66071f-4441-4666-9495-8a5ee6882a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:00.697792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 730/1461] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:00 2022] DELETE /identity/v3/projects/57aea106904c4acf8b5535cb0295878a => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:00.703412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30a5c3-3831-4a28-bdf9-e9efa7e4e260 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:00.703908 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30a5c3-3831-4a28-bdf9-e9efa7e4e260 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:00.704171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30a5c3-3831-4a28-bdf9-e9efa7e4e260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:00.786261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-3f30a5c3-3831-4a28-bdf9-e9efa7e4e260 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:00.796729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3f30a5c3-3831-4a28-bdf9-e9efa7e4e260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:01.012094 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 732/1462] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:01.013592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18271a-0162-479d-b842-badce604c5be None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:01.013985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18271a-0162-479d-b842-badce604c5be None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:01.014381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18271a-0162-479d-b842-badce604c5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:01.069570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9e18271a-0162-479d-b842-badce604c5be None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:01.075602 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9e18271a-0162-479d-b842-badce604c5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:01.111227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 731/1463] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:01.111853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30a5c3-3831-4a28-bdf9-e9efa7e4e260 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:01.147158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30a5c3-3831-4a28-bdf9-e9efa7e4e260 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:01.155950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80cb73-287a-4cf4-a4f2-920159cea792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:01.157251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80cb73-287a-4cf4-a4f2-920159cea792 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:01.158061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80cb73-287a-4cf4-a4f2-920159cea792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:01.158678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80cb73-287a-4cf4-a4f2-920159cea792 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:01.159748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80cb73-287a-4cf4-a4f2-920159cea792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:01.160255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80cb73-287a-4cf4-a4f2-920159cea792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:01.163469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80cb73-287a-4cf4-a4f2-920159cea792 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:01.203575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 733/1464] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:01.208917 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18271a-0162-479d-b842-badce604c5be None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:01.225927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18271a-0162-479d-b842-badce604c5be None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:01.243725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a8c26-223a-4010-b0e9-af4ea5e50576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:01.247157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8c26-223a-4010-b0e9-af4ea5e50576 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:01.247534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8c26-223a-4010-b0e9-af4ea5e50576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:01.247926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8c26-223a-4010-b0e9-af4ea5e50576 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:01.264181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a8c26-223a-4010-b0e9-af4ea5e50576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:01.273919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a8c26-223a-4010-b0e9-af4ea5e50576 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:01.366202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80cb73-287a-4cf4-a4f2-920159cea792 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:01.366379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 732/1465] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:01 2022] POST /identity/v3/projects => generated 393 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:01.398444 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80cb73-287a-4cf4-a4f2-920159cea792 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:01.469245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:01.701039 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b2a0a-f830-4dcd-bc63-062eb7ca808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:01.701666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2a0a-f830-4dcd-bc63-062eb7ca808f admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:01.701953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2a0a-f830-4dcd-bc63-062eb7ca808f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:01.702229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2a0a-f830-4dcd-bc63-062eb7ca808f admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:01.704440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b2a0a-f830-4dcd-bc63-062eb7ca808f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:01.712280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b2a0a-f830-4dcd-bc63-062eb7ca808f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:01.750056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 734/1466] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:01 2022] POST /identity/v3/users => generated 297 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:01.757334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a8c26-223a-4010-b0e9-af4ea5e50576 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:01.774379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a8c26-223a-4010-b0e9-af4ea5e50576 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:01.819680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f459e4-14fe-4862-9bcc-f56e6c9a09fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:01.820415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f459e4-14fe-4862-9bcc-f56e6c9a09fb admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:01.820666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f459e4-14fe-4862-9bcc-f56e6c9a09fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:01.820950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f459e4-14fe-4862-9bcc-f56e6c9a09fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:01.821714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f459e4-14fe-4862-9bcc-f56e6c9a09fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:01.823368 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f459e4-14fe-4862-9bcc-f56e6c9a09fb admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:01.894614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 733/1467] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:01.899003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b2a0a-f830-4dcd-bc63-062eb7ca808f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:01.914384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b2a0a-f830-4dcd-bc63-062eb7ca808f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:01.942639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f13db-420d-45e0-8632-47dd063e44cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:01.943287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f13db-420d-45e0-8632-47dd063e44cc admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:01.943575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f13db-420d-45e0-8632-47dd063e44cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:01.943885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f13db-420d-45e0-8632-47dd063e44cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:01.944575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f13db-420d-45e0-8632-47dd063e44cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:01.948514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f13db-420d-45e0-8632-47dd063e44cc admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:01.978878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 735/1468] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:01.980197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f459e4-14fe-4862-9bcc-f56e6c9a09fb admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:01.998445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f459e4-14fe-4862-9bcc-f56e6c9a09fb admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.008287 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d7081-639c-4ca5-93c9-201522147c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.009595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d7081-639c-4ca5-93c9-201522147c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.010080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d7081-639c-4ca5-93c9-201522147c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.010582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d7081-639c-4ca5-93c9-201522147c63 admin admin] PATH_INFO: `/v3/projects/e138697382294fc79331a1acfc0cb7c3/users/b8e2b5b4210d4a7585eb6bbb09911a4f/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.084306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d7081-639c-4ca5-93c9-201522147c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e138697382294fc79331a1acfc0cb7c3, user_id=b8e2b5b4210d4a7585eb6bbb09911a4f, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:02.100344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d7081-639c-4ca5-93c9-201522147c63 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:02.152552 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 734/1469] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:01 2022] PUT /identity/v3/projects/e138697382294fc79331a1acfc0cb7c3/users/b8e2b5b4210d4a7585eb6bbb09911a4f/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:02.165026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522208ea-dd45-4760-9ca5-675c0c6dad2a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.165499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522208ea-dd45-4760-9ca5-675c0c6dad2a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.165991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522208ea-dd45-4760-9ca5-675c0c6dad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.261545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-522208ea-dd45-4760-9ca5-675c0c6dad2a None None] MFA Rules not processed for user `b8e2b5b4210d4a7585eb6bbb09911a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.263040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-522208ea-dd45-4760-9ca5-675c0c6dad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.327317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d7081-639c-4ca5-93c9-201522147c63 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:02.330372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-178d7081-639c-4ca5-93c9-201522147c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.478427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 736/1470] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:02.480791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:02.481686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522208ea-dd45-4760-9ca5-675c0c6dad2a None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:02.571303 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d7081-639c-4ca5-93c9-201522147c63 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.594597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.595323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.598358 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.598686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] PATH_INFO: `/v3/users/9ccbac9004204dedad44d916ed05b4b3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.600174 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ccbac9004204dedad44d916ed05b4b3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:02.602574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:02.715665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522208ea-dd45-4760-9ca5-675c0c6dad2a None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.716688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ccbac9004204dedad44d916ed05b4b3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:02.727944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc88cf-7f21-46d6-8f50-3ee45615c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.728895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc88cf-7f21-46d6-8f50-3ee45615c359 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.729392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc88cf-7f21-46d6-8f50-3ee45615c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.729673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc88cf-7f21-46d6-8f50-3ee45615c359 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.729896 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ccbac9004204dedad44d916ed05b4b3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:02.730561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc88cf-7f21-46d6-8f50-3ee45615c359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:02.732971 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc88cf-7f21-46d6-8f50-3ee45615c359 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:02.747546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ccbac9004204dedad44d916ed05b4b3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:02.748283 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ccbac9004204dedad44d916ed05b4b3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:02.748960 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b76d6b13-9f00-4a9c-ad84-75f9ec1a2726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ccbac9004204dedad44d916ed05b4b3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:02.775489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 735/1471] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:02 2022] DELETE /identity/v3/users/9ccbac9004204dedad44d916ed05b4b3 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:02.777539 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fcbbd-17a1-49e8-8098-657aa17d200d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.777842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fcbbd-17a1-49e8-8098-657aa17d200d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.778440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fcbbd-17a1-49e8-8098-657aa17d200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.781029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 737/1472] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/projects => generated 393 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:02.784144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc88cf-7f21-46d6-8f50-3ee45615c359 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:02.787080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f4dc88cf-7f21-46d6-8f50-3ee45615c359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.807098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:02.829712 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-041fcbbd-17a1-49e8-8098-657aa17d200d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:02.834064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-041fcbbd-17a1-49e8-8098-657aa17d200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:02.966874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc88cf-7f21-46d6-8f50-3ee45615c359 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:02.996251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011c245-2206-4e19-a684-76b0a2cfaa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:02.996912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011c245-2206-4e19-a684-76b0a2cfaa54 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:02.997189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011c245-2206-4e19-a684-76b0a2cfaa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:02.997778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011c245-2206-4e19-a684-76b0a2cfaa54 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:02.998280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011c245-2206-4e19-a684-76b0a2cfaa54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.001054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011c245-2206-4e19-a684-76b0a2cfaa54 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.013865 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 736/1473] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:03.041179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fcbbd-17a1-49e8-8098-657aa17d200d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.043328 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-041fcbbd-17a1-49e8-8098-657aa17d200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:03.055009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 738/1474] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:02 2022] POST /identity/v3/users => generated 303 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:03.056035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011c245-2206-4e19-a684-76b0a2cfaa54 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.088538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011c245-2206-4e19-a684-76b0a2cfaa54 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.100704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487dc1b-136b-4f92-a6d4-2289a68f93bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.101418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487dc1b-136b-4f92-a6d4-2289a68f93bb admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.101697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487dc1b-136b-4f92-a6d4-2289a68f93bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.101967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487dc1b-136b-4f92-a6d4-2289a68f93bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.102625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487dc1b-136b-4f92-a6d4-2289a68f93bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.104276 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487dc1b-136b-4f92-a6d4-2289a68f93bb admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.132029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 739/1475] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:03.141432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487dc1b-136b-4f92-a6d4-2289a68f93bb admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.163508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487dc1b-136b-4f92-a6d4-2289a68f93bb admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.181920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad3669-1984-4da8-86d6-77372fd628fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.182672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad3669-1984-4da8-86d6-77372fd628fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.182953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad3669-1984-4da8-86d6-77372fd628fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.183228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad3669-1984-4da8-86d6-77372fd628fd admin admin] PATH_INFO: `/v3/projects/575d8f89d00847fdb485834f1a0f57ab/users/ce170415c50c42689c2bf4296af87ab5/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.258457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fcbbd-17a1-49e8-8098-657aa17d200d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.262456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad3669-1984-4da8-86d6-77372fd628fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=575d8f89d00847fdb485834f1a0f57ab, user_id=ce170415c50c42689c2bf4296af87ab5, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.269448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1160af2-8084-4dc4-afc3-1c6d44a86632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.270088 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1160af2-8084-4dc4-afc3-1c6d44a86632 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.274272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad3669-1984-4da8-86d6-77372fd628fd admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.274816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1160af2-8084-4dc4-afc3-1c6d44a86632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.275097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1160af2-8084-4dc4-afc3-1c6d44a86632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.308876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1160af2-8084-4dc4-afc3-1c6d44a86632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.310465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1160af2-8084-4dc4-afc3-1c6d44a86632 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.322715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 740/1476] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:03 2022] PUT /identity/v3/projects/575d8f89d00847fdb485834f1a0f57ab/users/ce170415c50c42689c2bf4296af87ab5/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:03.326837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad3669-1984-4da8-86d6-77372fd628fd admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.329150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:03.361982 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 737/1477] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:03.539841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad3669-1984-4da8-86d6-77372fd628fd admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.556249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada579a-0267-4b4f-83c6-916731687cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.556924 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada579a-0267-4b4f-83c6-916731687cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.557201 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada579a-0267-4b4f-83c6-916731687cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.557476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada579a-0267-4b4f-83c6-916731687cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.558140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada579a-0267-4b4f-83c6-916731687cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.571483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada579a-0267-4b4f-83c6-916731687cfb admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.599914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 741/1478] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:03.600995 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1160af2-8084-4dc4-afc3-1c6d44a86632 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:03.613446 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1160af2-8084-4dc4-afc3-1c6d44a86632 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:03.637400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf20e7-e5f6-4a2b-b8ec-fa9e7c337216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:03.638304 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf20e7-e5f6-4a2b-b8ec-fa9e7c337216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.638684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf20e7-e5f6-4a2b-b8ec-fa9e7c337216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.639056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf20e7-e5f6-4a2b-b8ec-fa9e7c337216 admin admin] PATH_INFO: `/v3/projects/575d8f89d00847fdb485834f1a0f57ab/users/ce170415c50c42689c2bf4296af87ab5/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.653503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf20e7-e5f6-4a2b-b8ec-fa9e7c337216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575d8f89d00847fdb485834f1a0f57ab, user_id=ce170415c50c42689c2bf4296af87ab5, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:03.656484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf20e7-e5f6-4a2b-b8ec-fa9e7c337216 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:03.749402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 738/1479] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:03 2022] PUT /identity/v3/projects/575d8f89d00847fdb485834f1a0f57ab/users/ce170415c50c42689c2bf4296af87ab5/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:03.764670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2d8e3-6777-428a-8440-321326dd32cb None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:03.765206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2d8e3-6777-428a-8440-321326dd32cb None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:03.765472 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2d8e3-6777-428a-8440-321326dd32cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:03.840186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-33b2d8e3-6777-428a-8440-321326dd32cb None None] MFA Rules not processed for user `ce170415c50c42689c2bf4296af87ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:03.842565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-33b2d8e3-6777-428a-8440-321326dd32cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:04.072494 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:04.174027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 742/1480] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:04.187979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf20e7-e5f6-4a2b-b8ec-fa9e7c337216 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.190530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9adf20e7-e5f6-4a2b-b8ec-fa9e7c337216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:04.297582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf20e7-e5f6-4a2b-b8ec-fa9e7c337216 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.302156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec403527-900d-4de6-a930-57989bc9f973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.303755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec403527-900d-4de6-a930-57989bc9f973 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.304202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec403527-900d-4de6-a930-57989bc9f973 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.306826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec403527-900d-4de6-a930-57989bc9f973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.334063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec403527-900d-4de6-a930-57989bc9f973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.339299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec403527-900d-4de6-a930-57989bc9f973 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.369582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 739/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:04.548663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2d8e3-6777-428a-8440-321326dd32cb None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:04.584318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2d8e3-6777-428a-8440-321326dd32cb None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:04.595230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7033b48-3258-4993-bd5c-c436cfa67959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:04.596585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033b48-3258-4993-bd5c-c436cfa67959 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:04.596985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033b48-3258-4993-bd5c-c436cfa67959 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:04.597335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033b48-3258-4993-bd5c-c436cfa67959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:04.601164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b7033b48-3258-4993-bd5c-c436cfa67959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:04.725002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7033b48-3258-4993-bd5c-c436cfa67959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:04.729564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7033b48-3258-4993-bd5c-c436cfa67959 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:04.780822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 743/1482] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:05.016189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16b412-d7cb-4a3b-bcef-c169fb41fe3e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.016780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16b412-d7cb-4a3b-bcef-c169fb41fe3e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.016780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16b412-d7cb-4a3b-bcef-c169fb41fe3e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.018453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 740/1483] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:13:05.073497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ab77e-809c-4252-b018-08fe9413e240 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:05.073782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ab77e-809c-4252-b018-08fe9413e240 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:05.074171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ab77e-809c-4252-b018-08fe9413e240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:05.115708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-f53ab77e-809c-4252-b018-08fe9413e240 None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:05.117803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f53ab77e-809c-4252-b018-08fe9413e240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:05.372925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 744/1484] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:05.920643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16b412-d7cb-4a3b-bcef-c169fb41fe3e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.924957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fd16b412-d7cb-4a3b-bcef-c169fb41fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:05.971561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ab77e-809c-4252-b018-08fe9413e240 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:05.973886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f53ab77e-809c-4252-b018-08fe9413e240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:05.995432 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16b412-d7cb-4a3b-bcef-c169fb41fe3e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:06.017934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262f1d0-78e1-414a-9eeb-f9a50a3c4581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:06.018988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262f1d0-78e1-414a-9eeb-f9a50a3c4581 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.018988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262f1d0-78e1-414a-9eeb-f9a50a3c4581 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.019130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262f1d0-78e1-414a-9eeb-f9a50a3c4581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.045191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262f1d0-78e1-414a-9eeb-f9a50a3c4581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.046760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262f1d0-78e1-414a-9eeb-f9a50a3c4581 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.080265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 741/1485] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:06.305679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ab77e-809c-4252-b018-08fe9413e240 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:06.322177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:06.329511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.330168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.330781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] PATH_INFO: `/v3/users/57837e98f4044b14841c805faa5b4d08` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.335112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57837e98f4044b14841c805faa5b4d08)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.340207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.387499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:06.481645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57837e98f4044b14841c805faa5b4d08'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:06.490581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57837e98f4044b14841c805faa5b4d08'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:06.492044 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57837e98f4044b14841c805faa5b4d08'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:06.547700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57837e98f4044b14841c805faa5b4d08'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:06.548906 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57837e98f4044b14841c805faa5b4d08'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:06.584028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 745/1486] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:05 2022] DELETE /identity/v3/users/57837e98f4044b14841c805faa5b4d08 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:06.590502 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a578c4-4980-4da5-a4a2-baabb26321d2 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.591095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a578c4-4980-4da5-a4a2-baabb26321d2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.591537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a578c4-4980-4da5-a4a2-baabb26321d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.651386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:06.654361 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:06.655488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-47a578c4-4980-4da5-a4a2-baabb26321d2 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:06.659222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-47a578c4-4980-4da5-a4a2-baabb26321d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:06.805945 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc76ce9-96ed-4b83-a9e6-b8d58c11ded7 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:06.822112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:06.822786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:06.823077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:06.823350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] PATH_INFO: `/v3/projects/04a85610093f429b8bd85f25a7ddb5cc` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:06.825458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a85610093f429b8bd85f25a7ddb5cc)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:06.827467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:06.975550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a85610093f429b8bd85f25a7ddb5cc', 'request_id': 'req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:06.993017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 742/1487] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:06.993460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a85610093f429b8bd85f25a7ddb5cc', 'request_id': 'req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:07.006312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a85610093f429b8bd85f25a7ddb5cc', 'request_id': 'req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:07.053846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] The token cache is being invalidate because project 04a85610093f429b8bd85f25a7ddb5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:07.054101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:07.056832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:07.073195 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a578c4-4980-4da5-a4a2-baabb26321d2 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:07.074268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 746/1488] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:06 2022] DELETE /identity/v3/projects/04a85610093f429b8bd85f25a7ddb5cc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:07.084946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a578c4-4980-4da5-a4a2-baabb26321d2 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:07.138094 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:07.141484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:07.241834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:07.242973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.243546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.243961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] PATH_INFO: `/v3/users/b6483c32a5e44a649b754c16e26610b2` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.245790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6483c32a5e44a649b754c16e26610b2)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:07.248575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:07.285285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:07.310740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:07.372479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fb022-19d0-4005-b8f0-aad7eb2ae5a2 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:07.383373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca48dc6-1076-4635-98f9-413a0ba9f8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:07.387912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca48dc6-1076-4635-98f9-413a0ba9f8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.389364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca48dc6-1076-4635-98f9-413a0ba9f8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.389720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca48dc6-1076-4635-98f9-413a0ba9f8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.397968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-dca48dc6-1076-4635-98f9-413a0ba9f8a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:07.398802 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6483c32a5e44a649b754c16e26610b2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:07.424894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6483c32a5e44a649b754c16e26610b2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:07.442719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca48dc6-1076-4635-98f9-413a0ba9f8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:07.447488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca48dc6-1076-4635-98f9-413a0ba9f8a9 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:07.474579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6483c32a5e44a649b754c16e26610b2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:07.478023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6483c32a5e44a649b754c16e26610b2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:07.482029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6483c32a5e44a649b754c16e26610b2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:07.497766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 747/1489] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:07.499118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0a8de-f7c2-43d2-8bdd-b732776cb470 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.499401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0a8de-f7c2-43d2-8bdd-b732776cb470 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.499683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0a8de-f7c2-43d2-8bdd-b732776cb470 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.501055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 748/1490] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:13:07.530740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429feaf-f7df-405d-96f4-d135a8ed0dac None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.531030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429feaf-f7df-405d-96f4-d135a8ed0dac None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.531303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429feaf-f7df-405d-96f4-d135a8ed0dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.534729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 743/1491] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:07 2022] DELETE /identity/v3/users/b6483c32a5e44a649b754c16e26610b2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:07.576873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-f429feaf-f7df-405d-96f4-d135a8ed0dac None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:07.588678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f429feaf-f7df-405d-96f4-d135a8ed0dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:07.713156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:07.714817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:07.810661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 749/1492] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:07.856551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c3fc-9d08-44e7-98b3-8b6ecdd2d10c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:07.864533 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:07.865480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:07.865767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:07.866212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] PATH_INFO: `/v3/users/030f1ad00f854e70977c2a11098a1769` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:07.868237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] RBAC: Authorizing `identity:delete_user(user_id=030f1ad00f854e70977c2a11098a1769)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:07.871663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:07.966984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030f1ad00f854e70977c2a11098a1769'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:07.989106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030f1ad00f854e70977c2a11098a1769'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:08.023650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030f1ad00f854e70977c2a11098a1769'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:08.025027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030f1ad00f854e70977c2a11098a1769'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:08.025984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030f1ad00f854e70977c2a11098a1769'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:08.077000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 744/1493] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:07 2022] DELETE /identity/v3/users/030f1ad00f854e70977c2a11098a1769 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:08.082583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6b85-1025-4dc0-adef-f6ff4c1c82bf None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:08.083526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6b85-1025-4dc0-adef-f6ff4c1c82bf None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:08.084024 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6b85-1025-4dc0-adef-f6ff4c1c82bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:08.109103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ee4f6b85-1025-4dc0-adef-f6ff4c1c82bf None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:08.111302 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ee4f6b85-1025-4dc0-adef-f6ff4c1c82bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:08.253445 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 750/1494] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:08.338864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:08.340597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:08.423302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:08.613588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f964e-2277-4ad4-bfb7-b7456f54a86d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:08.622122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05190d6-c8b7-463b-b66f-48d3fae1b206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:08.623702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05190d6-c8b7-463b-b66f-48d3fae1b206 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:08.625412 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05190d6-c8b7-463b-b66f-48d3fae1b206 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:08.627611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05190d6-c8b7-463b-b66f-48d3fae1b206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:08.676284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05190d6-c8b7-463b-b66f-48d3fae1b206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:08.678671 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05190d6-c8b7-463b-b66f-48d3fae1b206 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:08.705210 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 745/1495] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:08.858898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f6b85-1025-4dc0-adef-f6ff4c1c82bf None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:08.862031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ee4f6b85-1025-4dc0-adef-f6ff4c1c82bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:08.993981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:09.022116 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f6b85-1025-4dc0-adef-f6ff4c1c82bf None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:09.034017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246441bf-a8fa-4c14-8e43-4c63615b2023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:09.034878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246441bf-a8fa-4c14-8e43-4c63615b2023 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:09.035307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246441bf-a8fa-4c14-8e43-4c63615b2023 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:09.035819 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246441bf-a8fa-4c14-8e43-4c63615b2023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:09.038763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-246441bf-a8fa-4c14-8e43-4c63615b2023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:09.063933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246441bf-a8fa-4c14-8e43-4c63615b2023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:09.066222 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246441bf-a8fa-4c14-8e43-4c63615b2023 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:09.085754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 751/1496] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:09.334370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05190d6-c8b7-463b-b66f-48d3fae1b206 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:09.335931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c05190d6-c8b7-463b-b66f-48d3fae1b206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:09.356044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05190d6-c8b7-463b-b66f-48d3fae1b206 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:09.368008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:09.368896 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:09.369175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:09.369444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] PATH_INFO: `/v3/projects/040260dcb87a455082b78ca30372f9a2` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:09.370786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040260dcb87a455082b78ca30372f9a2)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:09.373198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:09.501720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040260dcb87a455082b78ca30372f9a2', 'request_id': 'req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:09.515994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040260dcb87a455082b78ca30372f9a2', 'request_id': 'req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:09.533062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040260dcb87a455082b78ca30372f9a2', 'request_id': 'req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:09.548509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] The token cache is being invalidate because project 040260dcb87a455082b78ca30372f9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:09.548509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:09.549234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-14b1d6ca-ec17-4ec8-b691-0d0d14ea9883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:09.551211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 746/1497] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:09 2022] DELETE /identity/v3/projects/040260dcb87a455082b78ca30372f9a2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:09.557708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad272e5-f81a-48a9-ad15-5ab66fee79c2 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:09.558243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad272e5-f81a-48a9-ad15-5ab66fee79c2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:09.558453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad272e5-f81a-48a9-ad15-5ab66fee79c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:09.583314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-2ad272e5-f81a-48a9-ad15-5ab66fee79c2 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:09.584757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2ad272e5-f81a-48a9-ad15-5ab66fee79c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:09.676352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 752/1498] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:09.687666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed20d89-529d-48f3-9903-e53a83fc0e35 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:09.688048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed20d89-529d-48f3-9903-e53a83fc0e35 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:09.690031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed20d89-529d-48f3-9903-e53a83fc0e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:09.731260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-bed20d89-529d-48f3-9903-e53a83fc0e35 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:09.740868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bed20d89-529d-48f3-9903-e53a83fc0e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:09.774217 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 747/1499] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:09.779575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad272e5-f81a-48a9-ad15-5ab66fee79c2 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:09.781077 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed20d89-529d-48f3-9903-e53a83fc0e35 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:09.791668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bed20d89-529d-48f3-9903-e53a83fc0e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:09.798790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad272e5-f81a-48a9-ad15-5ab66fee79c2 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:09.808991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c86206-c3ba-4b93-888c-4bdca51e98ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:09.809920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c86206-c3ba-4b93-888c-4bdca51e98ee admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:09.811719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c86206-c3ba-4b93-888c-4bdca51e98ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:09.811719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c86206-c3ba-4b93-888c-4bdca51e98ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:09.811719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c86206-c3ba-4b93-888c-4bdca51e98ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:09.811719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c86206-c3ba-4b93-888c-4bdca51e98ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:09.813069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c86206-c3ba-4b93-888c-4bdca51e98ee admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:09.817334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed20d89-529d-48f3-9903-e53a83fc0e35 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:09.824022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:09.825994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:09.825994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:09.825994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] PATH_INFO: `/v3/projects/44ad05338fed4f73b271d927cdd2bf02` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:09.829658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ad05338fed4f73b271d927cdd2bf02)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:09.834775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:09.857448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 753/1500] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:09.859726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c86206-c3ba-4b93-888c-4bdca51e98ee admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:09.868700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-83c86206-c3ba-4b93-888c-4bdca51e98ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:09.910607 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c86206-c3ba-4b93-888c-4bdca51e98ee admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:09.938519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ad05338fed4f73b271d927cdd2bf02', 'request_id': 'req-30c639d5-f717-4d08-bbaa-6dccb93ec289'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:09.939280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:09.940858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:09.943826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:09.944316 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] PATH_INFO: `/v3/projects/e1e454e45bfc4ef484bbf989bcd36803` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:09.947959 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e454e45bfc4ef484bbf989bcd36803)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:09.954327 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ad05338fed4f73b271d927cdd2bf02', 'request_id': 'req-30c639d5-f717-4d08-bbaa-6dccb93ec289'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:09.955357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:09.967660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ad05338fed4f73b271d927cdd2bf02', 'request_id': 'req-30c639d5-f717-4d08-bbaa-6dccb93ec289'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:09.982982 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] The token cache is being invalidate because project 44ad05338fed4f73b271d927cdd2bf02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:09.983239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:09.984204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:09.986749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 748/1501] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:09 2022] DELETE /identity/v3/projects/44ad05338fed4f73b271d927cdd2bf02 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:09.988000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:09.990960 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.036231 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:10.066904 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e454e45bfc4ef484bbf989bcd36803', 'request_id': 'req-5fa92e9c-2b20-4075-ae83-16a30d387207'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.078697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e454e45bfc4ef484bbf989bcd36803', 'request_id': 'req-5fa92e9c-2b20-4075-ae83-16a30d387207'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.094610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e454e45bfc4ef484bbf989bcd36803', 'request_id': 'req-5fa92e9c-2b20-4075-ae83-16a30d387207'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.121861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] The token cache is being invalidate because project e1e454e45bfc4ef484bbf989bcd36803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:10.122239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.122943 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.125541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 754/1502] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:09 2022] DELETE /identity/v3/projects/e1e454e45bfc4ef484bbf989bcd36803 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:10.126738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.128264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.150072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c639d5-f717-4d08-bbaa-6dccb93ec289 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.223578 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:10.224390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556f37f-a260-4f9b-8cbd-900a4d09dd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.225488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f37f-a260-4f9b-8cbd-900a4d09dd17 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.225997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f37f-a260-4f9b-8cbd-900a4d09dd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.226461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f37f-a260-4f9b-8cbd-900a4d09dd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.227396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556f37f-a260-4f9b-8cbd-900a4d09dd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.230020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556f37f-a260-4f9b-8cbd-900a4d09dd17 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.244083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa92e9c-2b20-4075-ae83-16a30d387207 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.251108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.252378 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.252994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.253244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] PATH_INFO: `/v3/users/1e15c4bd5c514f14bc9216f76cf27905` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.254935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e15c4bd5c514f14bc9216f76cf27905)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.257239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.271763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 749/1503] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:09 2022] POST /identity/v3/projects => generated 371 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:10.273262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556f37f-a260-4f9b-8cbd-900a4d09dd17 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.276537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d556f37f-a260-4f9b-8cbd-900a4d09dd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.347652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e15c4bd5c514f14bc9216f76cf27905'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.355932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e15c4bd5c514f14bc9216f76cf27905'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.356699 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e15c4bd5c514f14bc9216f76cf27905'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.369472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556f37f-a260-4f9b-8cbd-900a4d09dd17 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.371389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e15c4bd5c514f14bc9216f76cf27905'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.372469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e15c4bd5c514f14bc9216f76cf27905'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.375519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.376192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.376564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.376875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] PATH_INFO: `/v3/users/1f1a748c2a234c5b96d16b9ce2e7c2d0` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.378144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1a748c2a234c5b96d16b9ce2e7c2d0)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.380435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.392898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 755/1504] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:10 2022] DELETE /identity/v3/users/1e15c4bd5c514f14bc9216f76cf27905 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:10.394044 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.395361 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.436754 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1a748c2a234c5b96d16b9ce2e7c2d0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.439124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:10.449862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1a748c2a234c5b96d16b9ce2e7c2d0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.468643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1a748c2a234c5b96d16b9ce2e7c2d0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.469463 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1a748c2a234c5b96d16b9ce2e7c2d0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.470155 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1a748c2a234c5b96d16b9ce2e7c2d0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.489017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 750/1505] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:10 2022] DELETE /identity/v3/users/1f1a748c2a234c5b96d16b9ce2e7c2d0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:10.490719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.492228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2759-9788-4a3a-9003-66a38483aa67 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.505171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.562114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.562877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.563205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.563494 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] PATH_INFO: `/v3/users/b8e2b5b4210d4a7585eb6bbb09911a4f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.564967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e2b5b4210d4a7585eb6bbb09911a4f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.568167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.602282 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:10.613797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf5b5f-6c9c-4a84-86cb-9ea7bf7d4a37 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.622067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2153e-2e8c-4504-888e-c2da63c3e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.623477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2153e-2e8c-4504-888e-c2da63c3e57b admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.623836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2153e-2e8c-4504-888e-c2da63c3e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.624212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2153e-2e8c-4504-888e-c2da63c3e57b admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.626594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2153e-2e8c-4504-888e-c2da63c3e57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.629158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2153e-2e8c-4504-888e-c2da63c3e57b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.640646 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e2b5b4210d4a7585eb6bbb09911a4f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.650694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e2b5b4210d4a7585eb6bbb09911a4f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.652000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e2b5b4210d4a7585eb6bbb09911a4f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.666342 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e2b5b4210d4a7585eb6bbb09911a4f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.667567 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3e190ab7-7ea5-4b3e-889b-7570e679eb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e2b5b4210d4a7585eb6bbb09911a4f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:10.677473 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 751/1506] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:10 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:10.681709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2153e-2e8c-4504-888e-c2da63c3e57b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.685023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2ac2153e-2e8c-4504-888e-c2da63c3e57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.689881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 756/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:10 2022] DELETE /identity/v3/users/b8e2b5b4210d4a7585eb6bbb09911a4f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:10.694141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7047b-a816-4758-a298-acd47f830756 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.694421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7047b-a816-4758-a298-acd47f830756 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.695317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7047b-a816-4758-a298-acd47f830756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.708442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2153e-2e8c-4504-888e-c2da63c3e57b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.723859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-67a7047b-a816-4758-a298-acd47f830756 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:10.725875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-67a7047b-a816-4758-a298-acd47f830756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.801731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 757/1508] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:10.835084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7047b-a816-4758-a298-acd47f830756 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.836899 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-67a7047b-a816-4758-a298-acd47f830756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.869684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047e9e6-bfc7-4829-8ef5-00a9467111db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.870251 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047e9e6-bfc7-4829-8ef5-00a9467111db admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.870591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047e9e6-bfc7-4829-8ef5-00a9467111db admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.870768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047e9e6-bfc7-4829-8ef5-00a9467111db admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.871556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047e9e6-bfc7-4829-8ef5-00a9467111db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.876637 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047e9e6-bfc7-4829-8ef5-00a9467111db admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.917638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 752/1509] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:10.920182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047e9e6-bfc7-4829-8ef5-00a9467111db admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.927296 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c047e9e6-bfc7-4829-8ef5-00a9467111db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:10.939120 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7047b-a816-4758-a298-acd47f830756 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.943472 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9abc88-e1d9-4428-83a0-92df18f1fa77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.944248 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9abc88-e1d9-4428-83a0-92df18f1fa77 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.945173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9abc88-e1d9-4428-83a0-92df18f1fa77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.945531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9abc88-e1d9-4428-83a0-92df18f1fa77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.949749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047e9e6-bfc7-4829-8ef5-00a9467111db admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:10.957227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:10.957949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9abc88-e1d9-4428-83a0-92df18f1fa77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.958067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:10.958403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:10.958733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] PATH_INFO: `/v3/projects/976c4925664a44639b917f7a73efb2af` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:10.959943 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9abc88-e1d9-4428-83a0-92df18f1fa77 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.960061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] RBAC: Authorizing `identity:delete_project(project_id=976c4925664a44639b917f7a73efb2af)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:10.962208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:10.974817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 758/1510] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:10.975702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9abc88-e1d9-4428-83a0-92df18f1fa77 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:10.989605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9abc88-e1d9-4428-83a0-92df18f1fa77 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.009670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36d0fc-6a20-402a-98f9-1e09e932fbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.013148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d0fc-6a20-402a-98f9-1e09e932fbdf admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.013446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d0fc-6a20-402a-98f9-1e09e932fbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.013859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d0fc-6a20-402a-98f9-1e09e932fbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.017001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36d0fc-6a20-402a-98f9-1e09e932fbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.019578 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36d0fc-6a20-402a-98f9-1e09e932fbdf admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.020271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:11.022897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976c4925664a44639b917f7a73efb2af', 'request_id': 'req-dfc9d736-a512-493a-a58b-5dab02c7999d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.034961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976c4925664a44639b917f7a73efb2af', 'request_id': 'req-dfc9d736-a512-493a-a58b-5dab02c7999d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.049510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 759/1511] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:11.049847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976c4925664a44639b917f7a73efb2af', 'request_id': 'req-dfc9d736-a512-493a-a58b-5dab02c7999d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.060992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36d0fc-6a20-402a-98f9-1e09e932fbdf admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:11.086562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36d0fc-6a20-402a-98f9-1e09e932fbdf admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.089221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] The token cache is being invalidate because project 976c4925664a44639b917f7a73efb2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:11.089683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.090706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-dfc9d736-a512-493a-a58b-5dab02c7999d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.093290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 753/1512] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:10 2022] DELETE /identity/v3/projects/976c4925664a44639b917f7a73efb2af => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:11.100743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727cf75-41c4-4422-837b-6f2eae28a491 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.100743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727cf75-41c4-4422-837b-6f2eae28a491 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.100743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727cf75-41c4-4422-837b-6f2eae28a491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.127731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2727cf75-41c4-4422-837b-6f2eae28a491 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:11.128812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:11.130184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2727cf75-41c4-4422-837b-6f2eae28a491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.166946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270343db-ad77-4db9-a952-2f35bb9dc463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.167803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270343db-ad77-4db9-a952-2f35bb9dc463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.168178 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270343db-ad77-4db9-a952-2f35bb9dc463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.168596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270343db-ad77-4db9-a952-2f35bb9dc463 admin admin] PATH_INFO: `/v3/projects/5d1458f118244ff7afc392fcf20f45db/users/d48d53578999476aa743c0723846ee98/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.189346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270343db-ad77-4db9-a952-2f35bb9dc463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1458f118244ff7afc392fcf20f45db, user_id=d48d53578999476aa743c0723846ee98, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.193380 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270343db-ad77-4db9-a952-2f35bb9dc463 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.212226 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 760/1513] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:11 2022] PUT /identity/v3/projects/5d1458f118244ff7afc392fcf20f45db/users/d48d53578999476aa743c0723846ee98/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:11.213498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270343db-ad77-4db9-a952-2f35bb9dc463 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:11.215189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-270343db-ad77-4db9-a952-2f35bb9dc463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.231281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 754/1514] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:11.237862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e51f7-a072-44f0-bde0-1bded1106b07 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.237862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e51f7-a072-44f0-bde0-1bded1106b07 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.237862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e51f7-a072-44f0-bde0-1bded1106b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.281047 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b44e51f7-a072-44f0-bde0-1bded1106b07 None None] MFA Rules not processed for user `d48d53578999476aa743c0723846ee98`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:11.282407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b44e51f7-a072-44f0-bde0-1bded1106b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.326457 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270343db-ad77-4db9-a952-2f35bb9dc463 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.333244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.334481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.336683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.337040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] PATH_INFO: `/v3/projects/30400678c83b4c4c8c583dfebcf865d6` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.338520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30400678c83b4c4c8c583dfebcf865d6)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.340741 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.362722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 755/1515] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:11.364257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c7e7b-2496-493f-855f-35392454f544 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.364741 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c7e7b-2496-493f-855f-35392454f544 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.365349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c7e7b-2496-493f-855f-35392454f544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.391351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ee5c7e7b-2496-493f-855f-35392454f544 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:11.394280 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ee5c7e7b-2496-493f-855f-35392454f544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.408232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30400678c83b4c4c8c583dfebcf865d6', 'request_id': 'req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.415157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30400678c83b4c4c8c583dfebcf865d6', 'request_id': 'req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.424978 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30400678c83b4c4c8c583dfebcf865d6', 'request_id': 'req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.442047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] The token cache is being invalidate because project 30400678c83b4c4c8c583dfebcf865d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:11.442047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.442940 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.448088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 761/1516] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:11 2022] DELETE /identity/v3/projects/30400678c83b4c4c8c583dfebcf865d6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:11.448088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:11.448088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.484372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 756/1517] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:11.484372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61c01-36c8-4fdd-8ae6-7f5a818ffc27 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.484372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61c01-36c8-4fdd-8ae6-7f5a818ffc27 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.484372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61c01-36c8-4fdd-8ae6-7f5a818ffc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.498579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:11.505449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-99e61c01-36c8-4fdd-8ae6-7f5a818ffc27 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:11.508206 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-99e61c01-36c8-4fdd-8ae6-7f5a818ffc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.521007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 757/1518] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:11.522219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61c01-36c8-4fdd-8ae6-7f5a818ffc27 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:11.534520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61c01-36c8-4fdd-8ae6-7f5a818ffc27 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.535983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:11.546508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ac3b-e6b8-4514-bf8c-355373c6524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.547233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ac3b-e6b8-4514-bf8c-355373c6524a admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.547574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ac3b-e6b8-4514-bf8c-355373c6524a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.548281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ac3b-e6b8-4514-bf8c-355373c6524a admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.549729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74ac3b-e6b8-4514-bf8c-355373c6524a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:11.551134 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74ac3b-e6b8-4514-bf8c-355373c6524a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.555661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74ac3b-e6b8-4514-bf8c-355373c6524a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.563014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fe424-86fd-4dc0-813b-3398bb6ed4c7 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.571201 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51080c7-e70c-42be-b37e-5538336a859b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.572171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51080c7-e70c-42be-b37e-5538336a859b service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.572614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51080c7-e70c-42be-b37e-5538336a859b service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.573036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51080c7-e70c-42be-b37e-5538336a859b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.573954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 758/1519] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:11.574897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ac3b-e6b8-4514-bf8c-355373c6524a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:11.578543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9f74ac3b-e6b8-4514-bf8c-355373c6524a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.579616 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c51080c7-e70c-42be-b37e-5538336a859b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.611039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ac3b-e6b8-4514-bf8c-355373c6524a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.623039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.623756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.624065 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.624868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] PATH_INFO: `/v3/projects/e138697382294fc79331a1acfc0cb7c3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.627980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e138697382294fc79331a1acfc0cb7c3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.632980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.743178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e138697382294fc79331a1acfc0cb7c3', 'request_id': 'req-7636c2b3-06d8-4834-a920-b3393a143033'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.748420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51080c7-e70c-42be-b37e-5538336a859b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.750180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51080c7-e70c-42be-b37e-5538336a859b service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.757682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e138697382294fc79331a1acfc0cb7c3', 'request_id': 'req-7636c2b3-06d8-4834-a920-b3393a143033'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.767495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e138697382294fc79331a1acfc0cb7c3', 'request_id': 'req-7636c2b3-06d8-4834-a920-b3393a143033'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.781341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 762/1520] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:11.783879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] The token cache is being invalidate because project e138697382294fc79331a1acfc0cb7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:11.784409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.785283 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:11.788026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f883f85-1bf0-4136-a313-4f7b96b2cd45 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.796422 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f883f85-1bf0-4136-a313-4f7b96b2cd45 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.796422 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f883f85-1bf0-4136-a313-4f7b96b2cd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.797936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 759/1521] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:11 2022] DELETE /identity/v3/projects/e138697382294fc79331a1acfc0cb7c3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:11.800848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:11.808802 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.828699 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4f883f85-1bf0-4136-a313-4f7b96b2cd45 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:11.830545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4f883f85-1bf0-4136-a313-4f7b96b2cd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.912310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636c2b3-06d8-4834-a920-b3393a143033 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.921007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8bcd0-6bc5-4d9f-8c3a-99a3951d47a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.921007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8bcd0-6bc5-4d9f-8c3a-99a3951d47a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.921007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8bcd0-6bc5-4d9f-8c3a-99a3951d47a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.921007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8bcd0-6bc5-4d9f-8c3a-99a3951d47a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.921446 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8bcd0-6bc5-4d9f-8c3a-99a3951d47a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.922750 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 763/1522] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:11.924163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f883f85-1bf0-4136-a313-4f7b96b2cd45 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:11.925735 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4f883f85-1bf0-4136-a313-4f7b96b2cd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:11.927107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8bcd0-6bc5-4d9f-8c3a-99a3951d47a9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.943788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f883f85-1bf0-4136-a313-4f7b96b2cd45 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:11.951552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:11.954116 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:11.954537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:11.954958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] PATH_INFO: `/v3/users/ce170415c50c42689c2bf4296af87ab5` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:11.956750 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce170415c50c42689c2bf4296af87ab5)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:11.959151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:11.976052 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 760/1523] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:11 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:11.977298 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8bcd0-6bc5-4d9f-8c3a-99a3951d47a9 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:11.979112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-72e8bcd0-6bc5-4d9f-8c3a-99a3951d47a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:12.039362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce170415c50c42689c2bf4296af87ab5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.069793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce170415c50c42689c2bf4296af87ab5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.070793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce170415c50c42689c2bf4296af87ab5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.072117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:12.093624 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8bcd0-6bc5-4d9f-8c3a-99a3951d47a9 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.100620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce170415c50c42689c2bf4296af87ab5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.102108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce170415c50c42689c2bf4296af87ab5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.108078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.110007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.110423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.110854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] PATH_INFO: `/v3/users/d48d53578999476aa743c0723846ee98` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.115888 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48d53578999476aa743c0723846ee98)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.118535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.140264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 764/1524] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:11 2022] DELETE /identity/v3/users/ce170415c50c42689c2bf4296af87ab5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:12.143321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.157815 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:12.188621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:12.211857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48d53578999476aa743c0723846ee98'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.248500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48d53578999476aa743c0723846ee98'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.273746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48d53578999476aa743c0723846ee98'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.274586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48d53578999476aa743c0723846ee98'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.275627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48d53578999476aa743c0723846ee98'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:12.279583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4286a5c-680d-4471-9694-d955d2c1f599 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.287603 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad1318-14df-4fce-baca-03ee927f6ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.288958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad1318-14df-4fce-baca-03ee927f6ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.289931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad1318-14df-4fce-baca-03ee927f6ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.290429 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad1318-14df-4fce-baca-03ee927f6ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.291652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad1318-14df-4fce-baca-03ee927f6ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:12.292209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad1318-14df-4fce-baca-03ee927f6ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.295868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad1318-14df-4fce-baca-03ee927f6ad5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.296395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 761/1525] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:11 2022] DELETE /identity/v3/users/d48d53578999476aa743c0723846ee98 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:12.301542 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.303541 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:12.326420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 765/1526] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:12.331199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467db01-174f-4814-9652-acd481826fbf None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.331765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467db01-174f-4814-9652-acd481826fbf None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.333266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467db01-174f-4814-9652-acd481826fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.388218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b467db01-174f-4814-9652-acd481826fbf None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:12.390302 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b467db01-174f-4814-9652-acd481826fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:12.423328 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27baa63-ba65-4b39-9cbd-d8ea098c6858 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.440705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb976-7b38-4c29-b672-c6effb9d4710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.442422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb976-7b38-4c29-b672-c6effb9d4710 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.442950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb976-7b38-4c29-b672-c6effb9d4710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.443447 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb976-7b38-4c29-b672-c6effb9d4710 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.444485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eb976-7b38-4c29-b672-c6effb9d4710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.451428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eb976-7b38-4c29-b672-c6effb9d4710 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.494932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 766/1527] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:12.496388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467db01-174f-4814-9652-acd481826fbf None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.498052 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b467db01-174f-4814-9652-acd481826fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:12.512041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467db01-174f-4814-9652-acd481826fbf None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.522084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 762/1528] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:12 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:12.523102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb976-7b38-4c29-b672-c6effb9d4710 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.525504 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0b1eb976-7b38-4c29-b672-c6effb9d4710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:12.526582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9561e2-5882-4578-b21e-a8c7b9bdcde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.527458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9561e2-5882-4578-b21e-a8c7b9bdcde5 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.527458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9561e2-5882-4578-b21e-a8c7b9bdcde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.527978 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9561e2-5882-4578-b21e-a8c7b9bdcde5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.528380 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9561e2-5882-4578-b21e-a8c7b9bdcde5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.530295 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9561e2-5882-4578-b21e-a8c7b9bdcde5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.585265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 767/1529] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:12 2022] POST /identity/v3/projects => generated 369 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:12.591166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9561e2-5882-4578-b21e-a8c7b9bdcde5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.643858 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb976-7b38-4c29-b672-c6effb9d4710 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.671001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:12.732382 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f789e-ac26-4b4f-9557-46ff7bcc105b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.732942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f789e-ac26-4b4f-9557-46ff7bcc105b service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.733220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f789e-ac26-4b4f-9557-46ff7bcc105b service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.733511 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f789e-ac26-4b4f-9557-46ff7bcc105b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.734811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9561e2-5882-4578-b21e-a8c7b9bdcde5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.740697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011d846-ad90-471f-8fed-cf6f6eb1e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.743001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011d846-ad90-471f-8fed-cf6f6eb1e975 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.743521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011d846-ad90-471f-8fed-cf6f6eb1e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.743809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011d846-ad90-471f-8fed-cf6f6eb1e975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.744664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011d846-ad90-471f-8fed-cf6f6eb1e975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.745373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f789e-ac26-4b4f-9557-46ff7bcc105b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.746460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011d846-ad90-471f-8fed-cf6f6eb1e975 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.747067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f789e-ac26-4b4f-9557-46ff7bcc105b service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.757639 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 763/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:12.758467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f789e-ac26-4b4f-9557-46ff7bcc105b service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.766073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 768/1531] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:12.768992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f789e-ac26-4b4f-9557-46ff7bcc105b service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.769844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011d846-ad90-471f-8fed-cf6f6eb1e975 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.774151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b4f97-ed6d-4e18-b1ab-ec3133cc6245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.774834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b4f97-ed6d-4e18-b1ab-ec3133cc6245 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.775179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b4f97-ed6d-4e18-b1ab-ec3133cc6245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.775515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b4f97-ed6d-4e18-b1ab-ec3133cc6245 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.777041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b4f97-ed6d-4e18-b1ab-ec3133cc6245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.778390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b4f97-ed6d-4e18-b1ab-ec3133cc6245 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.787331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011d846-ad90-471f-8fed-cf6f6eb1e975 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.794357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f29a9-f042-4a78-a4b8-ad53b351f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.795393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f29a9-f042-4a78-a4b8-ad53b351f583 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.795794 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f29a9-f042-4a78-a4b8-ad53b351f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.796171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f29a9-f042-4a78-a4b8-ad53b351f583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.797216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f29a9-f042-4a78-a4b8-ad53b351f583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.799484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f29a9-f042-4a78-a4b8-ad53b351f583 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.804169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 764/1532] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:12 2022] POST /identity/v3/users => generated 285 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:12.808022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b4f97-ed6d-4e18-b1ab-ec3133cc6245 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.816031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 769/1533] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:12.817126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f29a9-f042-4a78-a4b8-ad53b351f583 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.820872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b4f97-ed6d-4e18-b1ab-ec3133cc6245 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.831988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f29a9-f042-4a78-a4b8-ad53b351f583 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.833028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcabb1-ba12-4540-ad56-22120b57e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.834040 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcabb1-ba12-4540-ad56-22120b57e950 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.834426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcabb1-ba12-4540-ad56-22120b57e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.834944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcabb1-ba12-4540-ad56-22120b57e950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.836556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcabb1-ba12-4540-ad56-22120b57e950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.838196 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddfcf2-7042-489e-bbcc-96e9e462285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.838896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddfcf2-7042-489e-bbcc-96e9e462285e admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.839167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddfcf2-7042-489e-bbcc-96e9e462285e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.839270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcabb1-ba12-4540-ad56-22120b57e950 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.839477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddfcf2-7042-489e-bbcc-96e9e462285e admin admin] PATH_INFO: `/v3/projects/2967e0c2f33747e8a60f25a12d12a3ec/users/0239dd35f8d74632b1793b9c1365fa88/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.851370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:12.869886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 765/1534] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:12.873724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcabb1-ba12-4540-ad56-22120b57e950 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.874909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddfcf2-7042-489e-bbcc-96e9e462285e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2967e0c2f33747e8a60f25a12d12a3ec, user_id=0239dd35f8d74632b1793b9c1365fa88, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.884536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddfcf2-7042-489e-bbcc-96e9e462285e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.888255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcabb1-ba12-4540-ad56-22120b57e950 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:12.895019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e0fa1-1e36-44d4-9e37-ddab21cffa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:12.895650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e0fa1-1e36-44d4-9e37-ddab21cffa81 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.895958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e0fa1-1e36-44d4-9e37-ddab21cffa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.896231 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e0fa1-1e36-44d4-9e37-ddab21cffa81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.897112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e0fa1-1e36-44d4-9e37-ddab21cffa81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:12.899612 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e0fa1-1e36-44d4-9e37-ddab21cffa81 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:12.912784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 770/1535] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:12 2022] PUT /identity/v3/projects/2967e0c2f33747e8a60f25a12d12a3ec/users/0239dd35f8d74632b1793b9c1365fa88/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:12.922956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 766/1536] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:12.927031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772798d7-825b-4a59-810f-bae0c0ac5217 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:12.927525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772798d7-825b-4a59-810f-bae0c0ac5217 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:12.927873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772798d7-825b-4a59-810f-bae0c0ac5217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:12.933660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e0fa1-1e36-44d4-9e37-ddab21cffa81 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:12.951533 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e0fa1-1e36-44d4-9e37-ddab21cffa81 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.029903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4d1e-4f67-4d9d-98b8-ea182b9094f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:13.031292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4d1e-4f67-4d9d-98b8-ea182b9094f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.031583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4d1e-4f67-4d9d-98b8-ea182b9094f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.031950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4d1e-4f67-4d9d-98b8-ea182b9094f3 admin admin] PATH_INFO: `/v3/projects/46235cc8be54489e9dc9d7a8228a4ba4/users/3ec314b45bd44021b6d64672e978bb18/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.040063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-772798d7-825b-4a59-810f-bae0c0ac5217 None None] MFA Rules not processed for user `0239dd35f8d74632b1793b9c1365fa88`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:13.042948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-772798d7-825b-4a59-810f-bae0c0ac5217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.055387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4d1e-4f67-4d9d-98b8-ea182b9094f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46235cc8be54489e9dc9d7a8228a4ba4, user_id=3ec314b45bd44021b6d64672e978bb18, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:13.058723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4d1e-4f67-4d9d-98b8-ea182b9094f3 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:13.084344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 767/1537] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:12 2022] PUT /identity/v3/projects/46235cc8be54489e9dc9d7a8228a4ba4/users/3ec314b45bd44021b6d64672e978bb18/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:13.084344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4d1e-4f67-4d9d-98b8-ea182b9094f3 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.084344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4a1e4d1e-4f67-4d9d-98b8-ea182b9094f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.136397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 771/1538] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:13.136397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76b07-3095-412b-97b7-ae275035eb68 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.136397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76b07-3095-412b-97b7-ae275035eb68 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.136397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76b07-3095-412b-97b7-ae275035eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.168168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-42b76b07-3095-412b-97b7-ae275035eb68 None None] MFA Rules not processed for user `3ec314b45bd44021b6d64672e978bb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:13.169614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-42b76b07-3095-412b-97b7-ae275035eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.172988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4d1e-4f67-4d9d-98b8-ea182b9094f3 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.182251 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:13.183327 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.187777 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.188384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] PATH_INFO: `/v3/projects/575d8f89d00847fdb485834f1a0f57ab` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.189998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=575d8f89d00847fdb485834f1a0f57ab)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:13.193604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:13.205138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:13.263301 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575d8f89d00847fdb485834f1a0f57ab', 'request_id': 'req-52141664-7bf3-4219-acd0-bfecfaf006fc'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:13.268322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 772/1539] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:13.269440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b76b07-3095-412b-97b7-ae275035eb68 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.272669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-42b76b07-3095-412b-97b7-ae275035eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.273311 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575d8f89d00847fdb485834f1a0f57ab', 'request_id': 'req-52141664-7bf3-4219-acd0-bfecfaf006fc'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:13.282945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575d8f89d00847fdb485834f1a0f57ab', 'request_id': 'req-52141664-7bf3-4219-acd0-bfecfaf006fc'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:13.296069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] The token cache is being invalidate because project 575d8f89d00847fdb485834f1a0f57ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:13.296404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:13.297083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:13.300375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 768/1540] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:13 2022] DELETE /identity/v3/projects/575d8f89d00847fdb485834f1a0f57ab => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:13.300375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.302065 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.373833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b76b07-3095-412b-97b7-ae275035eb68 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.396188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:13.417909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52141664-7bf3-4219-acd0-bfecfaf006fc admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.422728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:13.423540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.424083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.424083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] PATH_INFO: `/v3/projects/5d1458f118244ff7afc392fcf20f45db` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.425352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1458f118244ff7afc392fcf20f45db)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:13.427508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:13.447811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65874b-5bac-44b5-b7ea-84eeb2158a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:13.448462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65874b-5bac-44b5-b7ea-84eeb2158a4d service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.448740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65874b-5bac-44b5-b7ea-84eeb2158a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.449009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65874b-5bac-44b5-b7ea-84eeb2158a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.450746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5d65874b-5bac-44b5-b7ea-84eeb2158a4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.485642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1458f118244ff7afc392fcf20f45db', 'request_id': 'req-a45257b1-0c97-4a35-a138-f9eebb19592b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:13.495002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1458f118244ff7afc392fcf20f45db', 'request_id': 'req-a45257b1-0c97-4a35-a138-f9eebb19592b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:13.502177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1458f118244ff7afc392fcf20f45db', 'request_id': 'req-a45257b1-0c97-4a35-a138-f9eebb19592b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:13.514665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] The token cache is being invalidate because project 5d1458f118244ff7afc392fcf20f45db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:13.515171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:13.515838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:13.517407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 769/1541] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:13 2022] DELETE /identity/v3/projects/5d1458f118244ff7afc392fcf20f45db => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:13.518156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.518921 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65874b-5bac-44b5-b7ea-84eeb2158a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:13.519461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.520950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65874b-5bac-44b5-b7ea-84eeb2158a4d service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:13.531234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 773/1542] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:13.532839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea7d54-74c6-4cb6-a0f2-32753329e858 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.533252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea7d54-74c6-4cb6-a0f2-32753329e858 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.533671 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea7d54-74c6-4cb6-a0f2-32753329e858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.573449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-53ea7d54-74c6-4cb6-a0f2-32753329e858 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:13.574748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-53ea7d54-74c6-4cb6-a0f2-32753329e858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.577775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:13.626314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45257b1-0c97-4a35-a138-f9eebb19592b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.631329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae8337-7099-4d41-83b7-a89b0f46a06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:13.632126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8337-7099-4d41-83b7-a89b0f46a06a admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.632519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8337-7099-4d41-83b7-a89b0f46a06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.632798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8337-7099-4d41-83b7-a89b0f46a06a admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.633442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae8337-7099-4d41-83b7-a89b0f46a06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:13.635685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae8337-7099-4d41-83b7-a89b0f46a06a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:13.668838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 774/1543] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:13.670488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d89c-6ec9-47b8-b764-9d55037a97ca None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.670714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 770/1544] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:13 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:13.671090 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d89c-6ec9-47b8-b764-9d55037a97ca None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.671630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d89c-6ec9-47b8-b764-9d55037a97ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.675326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae8337-7099-4d41-83b7-a89b0f46a06a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.696326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c502d89c-6ec9-47b8-b764-9d55037a97ca None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:13.697877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c502d89c-6ec9-47b8-b764-9d55037a97ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.795826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae8337-7099-4d41-83b7-a89b0f46a06a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.797270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 775/1545] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:13.799102 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76581b32-92ef-4302-bdec-3e858bab4229 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.799610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76581b32-92ef-4302-bdec-3e858bab4229 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.800037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76581b32-92ef-4302-bdec-3e858bab4229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.801367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dc4e2-2e11-4c64-8ad7-76d37db61f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:13.802068 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc4e2-2e11-4c64-8ad7-76d37db61f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.802347 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc4e2-2e11-4c64-8ad7-76d37db61f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.802663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc4e2-2e11-4c64-8ad7-76d37db61f26 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.803356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3dc4e2-2e11-4c64-8ad7-76d37db61f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:13.808808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3dc4e2-2e11-4c64-8ad7-76d37db61f26 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:13.826432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-76581b32-92ef-4302-bdec-3e858bab4229 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:13.828742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-76581b32-92ef-4302-bdec-3e858bab4229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.838091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 771/1546] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:13 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:13.839669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597fbc-d57c-49e3-a6e9-1e2c96191f2c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.840027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597fbc-d57c-49e3-a6e9-1e2c96191f2c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.840279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597fbc-d57c-49e3-a6e9-1e2c96191f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.849914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 776/1547] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:13.851330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76581b32-92ef-4302-bdec-3e858bab4229 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.868214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-30597fbc-d57c-49e3-a6e9-1e2c96191f2c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:13.869519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-30597fbc-d57c-49e3-a6e9-1e2c96191f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:13.869821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76581b32-92ef-4302-bdec-3e858bab4229 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.875348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01263b21-d7f5-4a78-9911-de82870d5f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:13.875980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01263b21-d7f5-4a78-9911-de82870d5f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.876260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01263b21-d7f5-4a78-9911-de82870d5f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.876607 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01263b21-d7f5-4a78-9911-de82870d5f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.877267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01263b21-d7f5-4a78-9911-de82870d5f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:13.878241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 772/1548] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:13.879071 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30597fbc-d57c-49e3-a6e9-1e2c96191f2c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.881493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01263b21-d7f5-4a78-9911-de82870d5f25 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:13.888742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:13.907997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 777/1549] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:13.909310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01263b21-d7f5-4a78-9911-de82870d5f25 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.913493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30597fbc-d57c-49e3-a6e9-1e2c96191f2c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.926368 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01263b21-d7f5-4a78-9911-de82870d5f25 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.937162 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140cfc3-ac9f-4ad3-bde2-87fdf69dff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:13.937809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140cfc3-ac9f-4ad3-bde2-87fdf69dff3a admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.938208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140cfc3-ac9f-4ad3-bde2-87fdf69dff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.938531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140cfc3-ac9f-4ad3-bde2-87fdf69dff3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.939261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140cfc3-ac9f-4ad3-bde2-87fdf69dff3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:13.939569 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd25ef-49e5-4d5a-b868-51bf62bb3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:13.939694 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140cfc3-ac9f-4ad3-bde2-87fdf69dff3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:13.940413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd25ef-49e5-4d5a-b868-51bf62bb3407 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:13.940819 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd25ef-49e5-4d5a-b868-51bf62bb3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:13.941186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd25ef-49e5-4d5a-b868-51bf62bb3407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:13.941499 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140cfc3-ac9f-4ad3-bde2-87fdf69dff3a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:13.942106 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd25ef-49e5-4d5a-b868-51bf62bb3407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:13.942505 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd25ef-49e5-4d5a-b868-51bf62bb3407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:13.944940 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd25ef-49e5-4d5a-b868-51bf62bb3407 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:13.961100 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 778/1550] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:13.962205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd25ef-49e5-4d5a-b868-51bf62bb3407 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.967977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 773/1551] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:13.970767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140cfc3-ac9f-4ad3-bde2-87fdf69dff3a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:13.986143 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd25ef-49e5-4d5a-b868-51bf62bb3407 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:13.994254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140cfc3-ac9f-4ad3-bde2-87fdf69dff3a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.009656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee984-5429-4679-8fc8-18fac1537d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.010255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbf1c8-a335-4d17-995e-27501a209723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.010605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee984-5429-4679-8fc8-18fac1537d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.010903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbf1c8-a335-4d17-995e-27501a209723 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.011072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee984-5429-4679-8fc8-18fac1537d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.011172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbf1c8-a335-4d17-995e-27501a209723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.011450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbf1c8-a335-4d17-995e-27501a209723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.011596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee984-5429-4679-8fc8-18fac1537d11 admin admin] PATH_INFO: `/v3/projects/f5230e72e79648a3a164ac7ca19d8bdd/users/c37dfe0824e14308b6cc2d77eeb916f7/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.012092 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbf1c8-a335-4d17-995e-27501a209723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.014392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbf1c8-a335-4d17-995e-27501a209723 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.048889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ee984-5429-4679-8fc8-18fac1537d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5230e72e79648a3a164ac7ca19d8bdd, user_id=c37dfe0824e14308b6cc2d77eeb916f7, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.052048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ee984-5429-4679-8fc8-18fac1537d11 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.063732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 774/1552] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:13 2022] POST /identity/v3/projects => generated 361 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:14.064678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbf1c8-a335-4d17-995e-27501a209723 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.080617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 779/1553] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:13 2022] PUT /identity/v3/projects/f5230e72e79648a3a164ac7ca19d8bdd/users/c37dfe0824e14308b6cc2d77eeb916f7/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:14.081786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee984-5429-4679-8fc8-18fac1537d11 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.159417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbf1c8-a335-4d17-995e-27501a209723 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.182826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:14.267116 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee984-5429-4679-8fc8-18fac1537d11 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.282650 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cba96-575f-4bf4-a10a-3636012f6a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.286497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cba96-575f-4bf4-a10a-3636012f6a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.286497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cba96-575f-4bf4-a10a-3636012f6a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.286777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cba96-575f-4bf4-a10a-3636012f6a2a admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.287239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cba96-575f-4bf4-a10a-3636012f6a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.289408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cba96-575f-4bf4-a10a-3636012f6a2a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.341216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 780/1554] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:14 2022] POST /identity/v3/users => generated 281 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:14.341216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cba96-575f-4bf4-a10a-3636012f6a2a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.345350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2d4ed-29bb-4041-acf3-750278bc2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.346871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2d4ed-29bb-4041-acf3-750278bc2724 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.347086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2d4ed-29bb-4041-acf3-750278bc2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.348517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2d4ed-29bb-4041-acf3-750278bc2724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.349196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2d4ed-29bb-4041-acf3-750278bc2724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.356322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2d4ed-29bb-4041-acf3-750278bc2724 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.370165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cba96-575f-4bf4-a10a-3636012f6a2a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.381633 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71083357-a3df-4ae6-94fe-7ba0de280464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.382075 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71083357-a3df-4ae6-94fe-7ba0de280464 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.382677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71083357-a3df-4ae6-94fe-7ba0de280464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.382946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71083357-a3df-4ae6-94fe-7ba0de280464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.383632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71083357-a3df-4ae6-94fe-7ba0de280464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.385280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71083357-a3df-4ae6-94fe-7ba0de280464 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.401102 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 781/1555] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:14.401993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71083357-a3df-4ae6-94fe-7ba0de280464 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.415312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 775/1556] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:14 2022] POST /identity/v3/projects => generated 387 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:14.416345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71083357-a3df-4ae6-94fe-7ba0de280464 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.416735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2d4ed-29bb-4041-acf3-750278bc2724 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.526858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b03ecd-d4f0-4860-84e8-81b070a620d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.527773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b03ecd-d4f0-4860-84e8-81b070a620d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.528399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b03ecd-d4f0-4860-84e8-81b070a620d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.528821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b03ecd-d4f0-4860-84e8-81b070a620d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.529811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b03ecd-d4f0-4860-84e8-81b070a620d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.531717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b03ecd-d4f0-4860-84e8-81b070a620d7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.551336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2d4ed-29bb-4041-acf3-750278bc2724 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.551897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 782/1557] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:14.552930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b03ecd-d4f0-4860-84e8-81b070a620d7 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.559107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb4ad8-69f8-446f-8329-cca664f7ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.560280 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb4ad8-69f8-446f-8329-cca664f7ef01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.560874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb4ad8-69f8-446f-8329-cca664f7ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.561292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb4ad8-69f8-446f-8329-cca664f7ef01 admin admin] PATH_INFO: `/v3/projects/f5230e72e79648a3a164ac7ca19d8bdd/users/c37dfe0824e14308b6cc2d77eeb916f7/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.563420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb4ad8-69f8-446f-8329-cca664f7ef01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5230e72e79648a3a164ac7ca19d8bdd, user_id=c37dfe0824e14308b6cc2d77eeb916f7, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.564521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b03ecd-d4f0-4860-84e8-81b070a620d7 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.567006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb4ad8-69f8-446f-8329-cca664f7ef01 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.570925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca2734-d95e-46a8-97dc-4147d019caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.572510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca2734-d95e-46a8-97dc-4147d019caa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.572954 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca2734-d95e-46a8-97dc-4147d019caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.573255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca2734-d95e-46a8-97dc-4147d019caa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.574308 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca2734-d95e-46a8-97dc-4147d019caa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.576951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca2734-d95e-46a8-97dc-4147d019caa9 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.583474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 776/1558] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:14 2022] PUT /identity/v3/projects/f5230e72e79648a3a164ac7ca19d8bdd/users/c37dfe0824e14308b6cc2d77eeb916f7/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:14.584687 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb4ad8-69f8-446f-8329-cca664f7ef01 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.616280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 783/1559] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:14 2022] POST /identity/v3/users => generated 294 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:14.618938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf8db7-9e4d-42cd-8620-4d2277d072eb None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.619243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf8db7-9e4d-42cd-8620-4d2277d072eb None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.620087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf8db7-9e4d-42cd-8620-4d2277d072eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.670202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-2bdf8db7-9e4d-42cd-8620-4d2277d072eb None None] MFA Rules not processed for user `c37dfe0824e14308b6cc2d77eeb916f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:14.672009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2bdf8db7-9e4d-42cd-8620-4d2277d072eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:14.673993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb4ad8-69f8-446f-8329-cca664f7ef01 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.680113 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:14.681168 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc559988-0c3c-4de9-b682-4cf1271cd382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.681790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc559988-0c3c-4de9-b682-4cf1271cd382 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.682087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc559988-0c3c-4de9-b682-4cf1271cd382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.682351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc559988-0c3c-4de9-b682-4cf1271cd382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.683021 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc559988-0c3c-4de9-b682-4cf1271cd382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.684973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc559988-0c3c-4de9-b682-4cf1271cd382 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.697600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 777/1560] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:14.698611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc559988-0c3c-4de9-b682-4cf1271cd382 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.732532 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc559988-0c3c-4de9-b682-4cf1271cd382 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.740685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646696-01f6-46d8-910d-3241f9a4db26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.741954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646696-01f6-46d8-910d-3241f9a4db26 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.742480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646696-01f6-46d8-910d-3241f9a4db26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.743181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646696-01f6-46d8-910d-3241f9a4db26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.744326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28646696-01f6-46d8-910d-3241f9a4db26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.746184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28646696-01f6-46d8-910d-3241f9a4db26 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.759027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 778/1561] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:14.760279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646696-01f6-46d8-910d-3241f9a4db26 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.783487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 784/1562] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:14.785127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf8db7-9e4d-42cd-8620-4d2277d072eb None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.792137 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646696-01f6-46d8-910d-3241f9a4db26 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.803953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddd30c-ef6b-4715-879e-e1e362873b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.805906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddd30c-ef6b-4715-879e-e1e362873b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.806185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddd30c-ef6b-4715-879e-e1e362873b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.806465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddd30c-ef6b-4715-879e-e1e362873b1e admin admin] PATH_INFO: `/v3/projects/f1c46efe1aed4994bb4755eefe1d09de/users/872da889409441c3a74438036201e86d/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.808065 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf8db7-9e4d-42cd-8620-4d2277d072eb None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.821332 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:14.822360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76964caf-5788-495c-b6b7-5943fc1eb008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.823387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964caf-5788-495c-b6b7-5943fc1eb008 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.823757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964caf-5788-495c-b6b7-5943fc1eb008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.824029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964caf-5788-495c-b6b7-5943fc1eb008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.825280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76964caf-5788-495c-b6b7-5943fc1eb008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.828478 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76964caf-5788-495c-b6b7-5943fc1eb008 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.836192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddd30c-ef6b-4715-879e-e1e362873b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c46efe1aed4994bb4755eefe1d09de, user_id=872da889409441c3a74438036201e86d, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.840867 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddd30c-ef6b-4715-879e-e1e362873b1e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.852879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 785/1563] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:14.853479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76964caf-5788-495c-b6b7-5943fc1eb008 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.862678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 779/1564] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:14 2022] PUT /identity/v3/projects/f1c46efe1aed4994bb4755eefe1d09de/users/872da889409441c3a74438036201e86d/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:14.863500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddd30c-ef6b-4715-879e-e1e362873b1e admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:14.864166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-76964caf-5788-495c-b6b7-5943fc1eb008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:14.932235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76964caf-5788-495c-b6b7-5943fc1eb008 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.939301 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddd30c-ef6b-4715-879e-e1e362873b1e admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:14.945825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea9626-a5bf-46bb-9bcd-3d8c2a621b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:14.946909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9626-a5bf-46bb-9bcd-3d8c2a621b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.947304 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9626-a5bf-46bb-9bcd-3d8c2a621b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.948423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9626-a5bf-46bb-9bcd-3d8c2a621b58 admin admin] PATH_INFO: `/v3/projects/8b380da108ca47f789a9b26863517fe5/users/6592770cd3d948afa565ae4faf528b52/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:14.970038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea9626-a5bf-46bb-9bcd-3d8c2a621b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b380da108ca47f789a9b26863517fe5, user_id=6592770cd3d948afa565ae4faf528b52, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:14.972866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea9626-a5bf-46bb-9bcd-3d8c2a621b58 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:14.996273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 780/1565] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:14 2022] PUT /identity/v3/projects/8b380da108ca47f789a9b26863517fe5/users/6592770cd3d948afa565ae4faf528b52/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:14.997954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28361-1cb7-4b38-a3f0-4afecc4d1412 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:14.998250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28361-1cb7-4b38-a3f0-4afecc4d1412 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:14.998530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28361-1cb7-4b38-a3f0-4afecc4d1412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.005651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12516eed-7717-4d25-988c-6aae461ebb65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.006404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12516eed-7717-4d25-988c-6aae461ebb65 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.007061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12516eed-7717-4d25-988c-6aae461ebb65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.007385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12516eed-7717-4d25-988c-6aae461ebb65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.031045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5af28361-1cb7-4b38-a3f0-4afecc4d1412 None None] MFA Rules not processed for user `872da889409441c3a74438036201e86d`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:15.032580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5af28361-1cb7-4b38-a3f0-4afecc4d1412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:15.094858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12516eed-7717-4d25-988c-6aae461ebb65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.096809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12516eed-7717-4d25-988c-6aae461ebb65 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.102003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:15.109401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 786/1566] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:15.111304 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6e16-778d-4c58-b994-8a9a27f6128c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.111304 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6e16-778d-4c58-b994-8a9a27f6128c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.111685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6e16-778d-4c58-b994-8a9a27f6128c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.156338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 781/1567] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:15.175926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5aec6e16-778d-4c58-b994-8a9a27f6128c None None] MFA Rules not processed for user `6592770cd3d948afa565ae4faf528b52`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:15.181189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5aec6e16-778d-4c58-b994-8a9a27f6128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:15.271771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28361-1cb7-4b38-a3f0-4afecc4d1412 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.305704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 787/1568] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:15.311111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6e16-778d-4c58-b994-8a9a27f6128c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.353888 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28361-1cb7-4b38-a3f0-4afecc4d1412 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.365333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae927bb-632f-43d9-bfc5-88318709008d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.366238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae927bb-632f-43d9-bfc5-88318709008d service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.367005 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae927bb-632f-43d9-bfc5-88318709008d service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.367334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae927bb-632f-43d9-bfc5-88318709008d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.379156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae927bb-632f-43d9-bfc5-88318709008d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.381242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae927bb-632f-43d9-bfc5-88318709008d service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.413769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 782/1569] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:15.422589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6e16-778d-4c58-b994-8a9a27f6128c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.429495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c07e0-4b14-4c53-834c-7a8b6f5baeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.429940 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c07e0-4b14-4c53-834c-7a8b6f5baeff admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.430129 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c07e0-4b14-4c53-834c-7a8b6f5baeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.430408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c07e0-4b14-4c53-834c-7a8b6f5baeff admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.431101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c07e0-4b14-4c53-834c-7a8b6f5baeff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.432604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae927bb-632f-43d9-bfc5-88318709008d service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.439656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:15.445463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c07e0-4b14-4c53-834c-7a8b6f5baeff admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.451800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae927bb-632f-43d9-bfc5-88318709008d service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.469956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.470879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.471348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.472089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] PATH_INFO: `/v3/users/872da889409441c3a74438036201e86d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.475508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=872da889409441c3a74438036201e86d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.480323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.490786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 788/1570] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:15 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:15.492580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c07e0-4b14-4c53-834c-7a8b6f5baeff admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.583625 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872da889409441c3a74438036201e86d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:15.610156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c07e0-4b14-4c53-834c-7a8b6f5baeff admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.610740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872da889409441c3a74438036201e86d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:15.616078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2251399-4614-4ec3-a356-a33ea2569b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.617251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251399-4614-4ec3-a356-a33ea2569b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.617594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251399-4614-4ec3-a356-a33ea2569b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.618118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251399-4614-4ec3-a356-a33ea2569b67 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.618929 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2251399-4614-4ec3-a356-a33ea2569b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.621524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2251399-4614-4ec3-a356-a33ea2569b67 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.643191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872da889409441c3a74438036201e86d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:15.643191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872da889409441c3a74438036201e86d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:15.643191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872da889409441c3a74438036201e86d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:15.652517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 789/1571] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:15 2022] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:15.655296 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255173-e977-4058-b950-12eae727cdda None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.657436 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255173-e977-4058-b950-12eae727cdda None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.657726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255173-e977-4058-b950-12eae727cdda None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.662221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 783/1572] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:15 2022] DELETE /identity/v3/users/872da889409441c3a74438036201e86d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:15.662221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.664360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:15.665016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 790/1573] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:13:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:13:15.668999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c199d0d-4eed-44e5-b61a-3d5fdac9e352 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.669302 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c199d0d-4eed-44e5-b61a-3d5fdac9e352 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.670183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c199d0d-4eed-44e5-b61a-3d5fdac9e352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.679945 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:15.695865 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-1c199d0d-4eed-44e5-b61a-3d5fdac9e352 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:15.697466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1c199d0d-4eed-44e5-b61a-3d5fdac9e352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:15.775324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f119e0c-27c4-43e7-8a39-184fe368f8cb admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.781159 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5933f-5580-4013-ba79-43270e3a251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.782748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5933f-5580-4013-ba79-43270e3a251e admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.783071 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5933f-5580-4013-ba79-43270e3a251e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.783348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5933f-5580-4013-ba79-43270e3a251e admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.785036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5933f-5580-4013-ba79-43270e3a251e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.786934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5933f-5580-4013-ba79-43270e3a251e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.801585 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 784/1574] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:15.803192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5e741-ed98-46d4-9212-e3cebc91063d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.803575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5e741-ed98-46d4-9212-e3cebc91063d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.803853 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5e741-ed98-46d4-9212-e3cebc91063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.815814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 791/1575] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:15.821181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c199d0d-4eed-44e5-b61a-3d5fdac9e352 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:15.838500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c199d0d-4eed-44e5-b61a-3d5fdac9e352 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:15.853383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-86d5e741-ed98-46d4-9212-e3cebc91063d None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:15.855613 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-86d5e741-ed98-46d4-9212-e3cebc91063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:15.855963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a761c-b784-4d6d-9a54-17803d3fe9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:15.856840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a761c-b784-4d6d-9a54-17803d3fe9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:15.857118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a761c-b784-4d6d-9a54-17803d3fe9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:15.857391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a761c-b784-4d6d-9a54-17803d3fe9a4 admin admin] PATH_INFO: `/v3/projects/faa659a457b947a7a4c96dd7d08ace77/users/6d11d4109f0d401d9801dff9441a8272/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:15.906836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a761c-b784-4d6d-9a54-17803d3fe9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa659a457b947a7a4c96dd7d08ace77, user_id=6d11d4109f0d401d9801dff9441a8272, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:15.909847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a761c-b784-4d6d-9a54-17803d3fe9a4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:15.962391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 792/1576] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:15 2022] PUT /identity/v3/projects/faa659a457b947a7a4c96dd7d08ace77/users/6d11d4109f0d401d9801dff9441a8272/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:15.964090 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a761c-b784-4d6d-9a54-17803d3fe9a4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.082146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 785/1577] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:16.124408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a761c-b784-4d6d-9a54-17803d3fe9a4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.136442 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fcc80-fba1-487c-848f-f687f9694b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.137133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fcc80-fba1-487c-848f-f687f9694b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.137416 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fcc80-fba1-487c-848f-f687f9694b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.137683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fcc80-fba1-487c-848f-f687f9694b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.138344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fcc80-fba1-487c-848f-f687f9694b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.141532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fcc80-fba1-487c-848f-f687f9694b48 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.165898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 793/1578] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:16.170044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5e741-ed98-46d4-9212-e3cebc91063d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.178324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:16.203484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5e741-ed98-46d4-9212-e3cebc91063d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.209661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3b063-d017-453f-b34e-281c63b3e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.211476 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b063-d017-453f-b34e-281c63b3e4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.212332 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b063-d017-453f-b34e-281c63b3e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.214847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b063-d017-453f-b34e-281c63b3e4b4 admin admin] PATH_INFO: `/v3/projects/faa659a457b947a7a4c96dd7d08ace77/users/6d11d4109f0d401d9801dff9441a8272/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.217143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3b063-d017-453f-b34e-281c63b3e4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa659a457b947a7a4c96dd7d08ace77, user_id=6d11d4109f0d401d9801dff9441a8272, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.224959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3b063-d017-453f-b34e-281c63b3e4b4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.240121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 786/1579] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:16 2022] PUT /identity/v3/projects/faa659a457b947a7a4c96dd7d08ace77/users/6d11d4109f0d401d9801dff9441a8272/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:16.252251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f53fe-2aef-46db-b952-b4b32fe76684 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.252646 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f53fe-2aef-46db-b952-b4b32fe76684 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.253348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f53fe-2aef-46db-b952-b4b32fe76684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.295171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-642f53fe-2aef-46db-b952-b4b32fe76684 None None] MFA Rules not processed for user `6d11d4109f0d401d9801dff9441a8272`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:16.296900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-642f53fe-2aef-46db-b952-b4b32fe76684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:16.312095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3b063-d017-453f-b34e-281c63b3e4b4 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.313998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e6f3b063-d017-453f-b34e-281c63b3e4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:16.425986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:16.433706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 794/1580] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:16.437574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3b063-d017-453f-b34e-281c63b3e4b4 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.449620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f53fe-2aef-46db-b952-b4b32fe76684 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.452006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-642f53fe-2aef-46db-b952-b4b32fe76684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:16.459902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b5aa5-9f66-4623-913d-f56fafe59c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.462159 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b5aa5-9f66-4623-913d-f56fafe59c5e service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.462159 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b5aa5-9f66-4623-913d-f56fafe59c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.462363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b5aa5-9f66-4623-913d-f56fafe59c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.601060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b5aa5-9f66-4623-913d-f56fafe59c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.602552 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b5aa5-9f66-4623-913d-f56fafe59c5e service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.615392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 787/1581] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:16.618357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b5aa5-9f66-4623-913d-f56fafe59c5e service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:16.618547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-768b5aa5-9f66-4623-913d-f56fafe59c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:16.731576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b5aa5-9f66-4623-913d-f56fafe59c5e service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.737807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f53fe-2aef-46db-b952-b4b32fe76684 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:16.742141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac675364-0d32-4678-9228-0c60184c52d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.742398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7845b0-7252-4678-a227-40b94bf1d8ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:16.743116 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7845b0-7252-4678-a227-40b94bf1d8ef service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.743471 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7845b0-7252-4678-a227-40b94bf1d8ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.743925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7845b0-7252-4678-a227-40b94bf1d8ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.744131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac675364-0d32-4678-9228-0c60184c52d5 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:16.745351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac675364-0d32-4678-9228-0c60184c52d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:16.746089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac675364-0d32-4678-9228-0c60184c52d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:16.765649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7845b0-7252-4678-a227-40b94bf1d8ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.766586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac675364-0d32-4678-9228-0c60184c52d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:16.767084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7845b0-7252-4678-a227-40b94bf1d8ef service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.768952 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac675364-0d32-4678-9228-0c60184c52d5 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:16.779404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 795/1582] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:16.788598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 788/1583] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:17.038737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7845b0-7252-4678-a227-40b94bf1d8ef service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:17.058209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7845b0-7252-4678-a227-40b94bf1d8ef service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:17.073721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:17.074653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.075027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.075387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] PATH_INFO: `/v3/users/6592770cd3d948afa565ae4faf528b52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.077701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6592770cd3d948afa565ae4faf528b52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:17.081178 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:17.185554 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6592770cd3d948afa565ae4faf528b52'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:17.194105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6592770cd3d948afa565ae4faf528b52'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:17.195193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6592770cd3d948afa565ae4faf528b52'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:17.210890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6592770cd3d948afa565ae4faf528b52'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:17.211792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6592770cd3d948afa565ae4faf528b52'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:17.230234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 796/1584] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:17 2022] DELETE /identity/v3/users/6592770cd3d948afa565ae4faf528b52 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:17.238139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194d121-eba9-4c39-a003-cbab71ecf31c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.238139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194d121-eba9-4c39-a003-cbab71ecf31c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.238139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194d121-eba9-4c39-a003-cbab71ecf31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.274543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f194d121-eba9-4c39-a003-cbab71ecf31c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:17.281897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f194d121-eba9-4c39-a003-cbab71ecf31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:17.287125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:17.288993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:17.364371 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:17.391736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337e7c7-fd5f-4940-a7aa-681867f19bb5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:17.410111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:17.410877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.411593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.412616 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] PATH_INFO: `/v3/projects/f1c46efe1aed4994bb4755eefe1d09de` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.414927 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c46efe1aed4994bb4755eefe1d09de)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:17.418260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:17.444387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:17.483721 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 789/1585] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:17.493143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194d121-eba9-4c39-a003-cbab71ecf31c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:17.495220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f194d121-eba9-4c39-a003-cbab71ecf31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:17.533877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c46efe1aed4994bb4755eefe1d09de', 'request_id': 'req-efb72059-025e-4b7c-bb4e-a46814ac4dc1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:17.544583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c46efe1aed4994bb4755eefe1d09de', 'request_id': 'req-efb72059-025e-4b7c-bb4e-a46814ac4dc1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:17.562866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c46efe1aed4994bb4755eefe1d09de', 'request_id': 'req-efb72059-025e-4b7c-bb4e-a46814ac4dc1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:17.584417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] The token cache is being invalidate because project f1c46efe1aed4994bb4755eefe1d09de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:17.584757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:17.585869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-efb72059-025e-4b7c-bb4e-a46814ac4dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:17.588284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 797/1586] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:17 2022] DELETE /identity/v3/projects/f1c46efe1aed4994bb4755eefe1d09de => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:17.593950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdb1cf-e26a-460a-b44b-0524bba96e20 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.594231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdb1cf-e26a-460a-b44b-0524bba96e20 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.594508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdb1cf-e26a-460a-b44b-0524bba96e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.631984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194d121-eba9-4c39-a003-cbab71ecf31c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:17.647371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d8fdb1cf-e26a-460a-b44b-0524bba96e20 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:17.649339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d8fdb1cf-e26a-460a-b44b-0524bba96e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:17.748183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4b9e-9730-4e6a-a66f-e69e0b5b2421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:17.753934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4b9e-9730-4e6a-a66f-e69e0b5b2421 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.754444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4b9e-9730-4e6a-a66f-e69e0b5b2421 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.755300 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4b9e-9730-4e6a-a66f-e69e0b5b2421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.760028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ad9e4b9e-9730-4e6a-a66f-e69e0b5b2421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:17.808757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 798/1587] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:17.812324 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13574930-8a98-4682-a444-e48d09bbf3f6 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.812601 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13574930-8a98-4682-a444-e48d09bbf3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.815227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13574930-8a98-4682-a444-e48d09bbf3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.868397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-13574930-8a98-4682-a444-e48d09bbf3f6 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:17.872076 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-13574930-8a98-4682-a444-e48d09bbf3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:17.891524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e4b9e-9730-4e6a-a66f-e69e0b5b2421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:17.893662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e4b9e-9730-4e6a-a66f-e69e0b5b2421 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:17.902428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 799/1588] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:17.908869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13574930-8a98-4682-a444-e48d09bbf3f6 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:17.919929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 790/1589] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:17.924385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13574930-8a98-4682-a444-e48d09bbf3f6 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:17.932237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a77e7-8703-4d3a-bd50-4db5969fa653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:17.932883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a77e7-8703-4d3a-bd50-4db5969fa653 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.938068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a77e7-8703-4d3a-bd50-4db5969fa653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.938068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a77e7-8703-4d3a-bd50-4db5969fa653 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.938068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a77e7-8703-4d3a-bd50-4db5969fa653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:17.938068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a77e7-8703-4d3a-bd50-4db5969fa653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:17.940145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a77e7-8703-4d3a-bd50-4db5969fa653 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:17.953205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 800/1590] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:17.957457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4b9e-9730-4e6a-a66f-e69e0b5b2421 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:17.963032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a77e7-8703-4d3a-bd50-4db5969fa653 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:17.965737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c37a77e7-8703-4d3a-bd50-4db5969fa653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:17.971597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4b9e-9730-4e6a-a66f-e69e0b5b2421 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:17.978809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f29181-9386-4f38-9f52-aa5fae36b2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:17.979643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f29181-9386-4f38-9f52-aa5fae36b2fb admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.980074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f29181-9386-4f38-9f52-aa5fae36b2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.980571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f29181-9386-4f38-9f52-aa5fae36b2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.981455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f29181-9386-4f38-9f52-aa5fae36b2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:17.983901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f29181-9386-4f38-9f52-aa5fae36b2fb admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:17.985791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a77e7-8703-4d3a-bd50-4db5969fa653 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:17.994280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:17.995195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:17.995748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:17.996167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] PATH_INFO: `/v3/users/3ec314b45bd44021b6d64672e978bb18` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:17.998183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec314b45bd44021b6d64672e978bb18)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.000352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.032200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 791/1591] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:17 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:18.035124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f29181-9386-4f38-9f52-aa5fae36b2fb admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.062736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:18.073345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec314b45bd44021b6d64672e978bb18'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.091325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec314b45bd44021b6d64672e978bb18'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.093183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec314b45bd44021b6d64672e978bb18'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.114586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec314b45bd44021b6d64672e978bb18'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.115837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-187b26bd-97d6-4315-92c2-1fe27dcbedde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec314b45bd44021b6d64672e978bb18'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.130458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:18.140968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 801/1592] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:17 2022] DELETE /identity/v3/users/3ec314b45bd44021b6d64672e978bb18 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:18.143104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0f214-9c55-4f62-89fa-6a491d000903 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.144122 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0f214-9c55-4f62-89fa-6a491d000903 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.144122 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0f214-9c55-4f62-89fa-6a491d000903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.165591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f29181-9386-4f38-9f52-aa5fae36b2fb admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:18.174819 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9bd0f214-9c55-4f62-89fa-6a491d000903 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:18.176332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9bd0f214-9c55-4f62-89fa-6a491d000903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:18.239509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e069483-f864-45bf-9ce0-4754696769ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:18.240072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069483-f864-45bf-9ce0-4754696769ad admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.240398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069483-f864-45bf-9ce0-4754696769ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.240729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069483-f864-45bf-9ce0-4754696769ad admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.241743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e069483-f864-45bf-9ce0-4754696769ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.244421 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e069483-f864-45bf-9ce0-4754696769ad admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.286389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 792/1593] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:18 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:18.293828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e069483-f864-45bf-9ce0-4754696769ad admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.294274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 802/1594] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:18.295579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1e069483-f864-45bf-9ce0-4754696769ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:18.309832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e069483-f864-45bf-9ce0-4754696769ad admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:18.315627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0f214-9c55-4f62-89fa-6a491d000903 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.316151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40b6a8-e23f-4408-9ef3-2d8f22947dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:18.316963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40b6a8-e23f-4408-9ef3-2d8f22947dff admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.317337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9bd0f214-9c55-4f62-89fa-6a491d000903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:18.317452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40b6a8-e23f-4408-9ef3-2d8f22947dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.317776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40b6a8-e23f-4408-9ef3-2d8f22947dff admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.318468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40b6a8-e23f-4408-9ef3-2d8f22947dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.320340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40b6a8-e23f-4408-9ef3-2d8f22947dff admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.331321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 793/1595] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:18.336131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40b6a8-e23f-4408-9ef3-2d8f22947dff admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.347263 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40b6a8-e23f-4408-9ef3-2d8f22947dff admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:18.352724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09794944-f440-4066-a88e-aefccaa51c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:18.353982 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09794944-f440-4066-a88e-aefccaa51c78 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.354400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09794944-f440-4066-a88e-aefccaa51c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.354689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09794944-f440-4066-a88e-aefccaa51c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.355345 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09794944-f440-4066-a88e-aefccaa51c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.357315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09794944-f440-4066-a88e-aefccaa51c78 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.369487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 794/1596] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:18.374124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09794944-f440-4066-a88e-aefccaa51c78 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.386332 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09794944-f440-4066-a88e-aefccaa51c78 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:18.391338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16497dbe-a731-499c-b237-f05c4904c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:18.391687 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0f214-9c55-4f62-89fa-6a491d000903 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:18.392013 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16497dbe-a731-499c-b237-f05c4904c5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.392305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16497dbe-a731-499c-b237-f05c4904c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.392607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16497dbe-a731-499c-b237-f05c4904c5b3 admin admin] PATH_INFO: `/v3/projects/33d65913fb2844789353a6d86177be04/users/dc385d15775c4d4abfc9610271ddf523/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.396337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad640644-1d47-4cb1-a47f-413509fce259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:18.396964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad640644-1d47-4cb1-a47f-413509fce259 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.397245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad640644-1d47-4cb1-a47f-413509fce259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.397525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad640644-1d47-4cb1-a47f-413509fce259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.407840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad640644-1d47-4cb1-a47f-413509fce259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.408650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16497dbe-a731-499c-b237-f05c4904c5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d65913fb2844789353a6d86177be04, user_id=dc385d15775c4d4abfc9610271ddf523, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.409103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad640644-1d47-4cb1-a47f-413509fce259 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.411329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16497dbe-a731-499c-b237-f05c4904c5b3 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.421992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 803/1597] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:18.428461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 795/1598] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:18 2022] PUT /identity/v3/projects/33d65913fb2844789353a6d86177be04/users/dc385d15775c4d4abfc9610271ddf523/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:18.438958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf036cf-9bde-4449-991d-dadade9e304c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.439242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf036cf-9bde-4449-991d-dadade9e304c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.439522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf036cf-9bde-4449-991d-dadade9e304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.478547 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-cdf036cf-9bde-4449-991d-dadade9e304c None None] MFA Rules not processed for user `dc385d15775c4d4abfc9610271ddf523`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:18.480602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cdf036cf-9bde-4449-991d-dadade9e304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:18.498489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16497dbe-a731-499c-b237-f05c4904c5b3 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.500899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-16497dbe-a731-499c-b237-f05c4904c5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:18.574286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 804/1599] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:18.588448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf036cf-9bde-4449-991d-dadade9e304c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.590676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cdf036cf-9bde-4449-991d-dadade9e304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:18.617430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16497dbe-a731-499c-b237-f05c4904c5b3 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:18.623655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:18.624660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.625079 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.626130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] PATH_INFO: `/v3/projects/8b380da108ca47f789a9b26863517fe5` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.627308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b380da108ca47f789a9b26863517fe5)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.629406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.631175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:18.634306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:18.664100 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf036cf-9bde-4449-991d-dadade9e304c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:18.668685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9022d7-7df7-4d85-a731-566f6d237bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:18.669391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9022d7-7df7-4d85-a731-566f6d237bfe service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.669613 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9022d7-7df7-4d85-a731-566f6d237bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.669949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9022d7-7df7-4d85-a731-566f6d237bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.680906 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9022d7-7df7-4d85-a731-566f6d237bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.682407 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9022d7-7df7-4d85-a731-566f6d237bfe service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.693493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 805/1600] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:18.707662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b380da108ca47f789a9b26863517fe5', 'request_id': 'req-4cb659a4-b9bb-450d-9874-57b33f48bc15'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.719818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b380da108ca47f789a9b26863517fe5', 'request_id': 'req-4cb659a4-b9bb-450d-9874-57b33f48bc15'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.736582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b380da108ca47f789a9b26863517fe5', 'request_id': 'req-4cb659a4-b9bb-450d-9874-57b33f48bc15'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.751413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] The token cache is being invalidate because project 8b380da108ca47f789a9b26863517fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:18.751930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.752787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.754727 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 796/1601] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:18 2022] DELETE /identity/v3/projects/8b380da108ca47f789a9b26863517fe5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:18.758731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9022d7-7df7-4d85-a731-566f6d237bfe service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.760803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:18.762348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:18.777148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9022d7-7df7-4d85-a731-566f6d237bfe service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:18.842478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb659a4-b9bb-450d-9874-57b33f48bc15 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:18.847537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:18.848197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.848507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.848788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] PATH_INFO: `/v3/projects/46235cc8be54489e9dc9d7a8228a4ba4` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.850136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46235cc8be54489e9dc9d7a8228a4ba4)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.852152 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.888221 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:18.888900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:18.889207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:18.889480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] PATH_INFO: `/v3/users/6d11d4109f0d401d9801dff9441a8272` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:18.894958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d11d4109f0d401d9801dff9441a8272)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:18.897800 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:18.933462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46235cc8be54489e9dc9d7a8228a4ba4', 'request_id': 'req-97c60271-17c2-4ef6-83d2-1dd434484cc8'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.954325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46235cc8be54489e9dc9d7a8228a4ba4', 'request_id': 'req-97c60271-17c2-4ef6-83d2-1dd434484cc8'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:18.985434 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46235cc8be54489e9dc9d7a8228a4ba4', 'request_id': 'req-97c60271-17c2-4ef6-83d2-1dd434484cc8'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.014323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] The token cache is being invalidate because project 46235cc8be54489e9dc9d7a8228a4ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:19.015449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.016237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.023228 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 797/1602] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:18 2022] DELETE /identity/v3/projects/46235cc8be54489e9dc9d7a8228a4ba4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:19.024664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:19.026503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:19.032067 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d11d4109f0d401d9801dff9441a8272'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.085395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d11d4109f0d401d9801dff9441a8272'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.086252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d11d4109f0d401d9801dff9441a8272'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.120762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d11d4109f0d401d9801dff9441a8272'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.121887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d11d4109f0d401d9801dff9441a8272'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.122725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:19.174661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 806/1603] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:18 2022] DELETE /identity/v3/users/6d11d4109f0d401d9801dff9441a8272 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:19.240692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c60271-17c2-4ef6-83d2-1dd434484cc8 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:19.326819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:19.327563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.327861 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.328379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] PATH_INFO: `/v3/users/c37dfe0824e14308b6cc2d77eeb916f7` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.329867 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37dfe0824e14308b6cc2d77eeb916f7)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:19.332285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:19.542610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37dfe0824e14308b6cc2d77eeb916f7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.552031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37dfe0824e14308b6cc2d77eeb916f7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.567992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37dfe0824e14308b6cc2d77eeb916f7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.568851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37dfe0824e14308b6cc2d77eeb916f7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.569599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-31acb9db-6b67-4ed2-b248-579ac9acce40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37dfe0824e14308b6cc2d77eeb916f7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:19.585825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 798/1604] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:19 2022] DELETE /identity/v3/users/c37dfe0824e14308b6cc2d77eeb916f7 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:19.857153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:19.858715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:19.874536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014a9ea-23e9-4bb5-8e4f-4fdbefec15c1 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:19.943777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:19.957047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:19.957707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:19.957988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:19.958261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] PATH_INFO: `/v3/projects/faa659a457b947a7a4c96dd7d08ace77` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:19.959713 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa659a457b947a7a4c96dd7d08ace77)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:19.962482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.019589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa659a457b947a7a4c96dd7d08ace77', 'request_id': 'req-82b013a3-081e-4bee-bf2f-133f2889dcd5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.028019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa659a457b947a7a4c96dd7d08ace77', 'request_id': 'req-82b013a3-081e-4bee-bf2f-133f2889dcd5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.035838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa659a457b947a7a4c96dd7d08ace77', 'request_id': 'req-82b013a3-081e-4bee-bf2f-133f2889dcd5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.058007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] The token cache is being invalidate because project faa659a457b947a7a4c96dd7d08ace77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:20.058399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.059694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.065866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 807/1605] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:19 2022] DELETE /identity/v3/projects/faa659a457b947a7a4c96dd7d08ace77 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:20.072955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3fc9f-e5f7-4e00-8913-7949f7be018a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.073514 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3fc9f-e5f7-4e00-8913-7949f7be018a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.073700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3fc9f-e5f7-4e00-8913-7949f7be018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.080849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.082254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:20.094527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-98f3fc9f-e5f7-4e00-8913-7949f7be018a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:20.095899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-98f3fc9f-e5f7-4e00-8913-7949f7be018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:20.151731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:20.154905 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b013a3-081e-4bee-bf2f-133f2889dcd5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.163124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.163606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.164009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.164317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] PATH_INFO: `/v3/projects/f5230e72e79648a3a164ac7ca19d8bdd` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.165512 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5230e72e79648a3a164ac7ca19d8bdd)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.167777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.178715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 799/1606] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:20.179784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3fc9f-e5f7-4e00-8913-7949f7be018a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.181289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-98f3fc9f-e5f7-4e00-8913-7949f7be018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:20.193184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3fc9f-e5f7-4e00-8913-7949f7be018a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.197954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.198710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.198991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.199255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] PATH_INFO: `/v3/users/0239dd35f8d74632b1793b9c1365fa88` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.200729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0239dd35f8d74632b1793b9c1365fa88)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.202827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.228899 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5230e72e79648a3a164ac7ca19d8bdd', 'request_id': 'req-8664496e-dfb3-40e6-b379-4542d769b70a'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.235309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5230e72e79648a3a164ac7ca19d8bdd', 'request_id': 'req-8664496e-dfb3-40e6-b379-4542d769b70a'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.242376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5230e72e79648a3a164ac7ca19d8bdd', 'request_id': 'req-8664496e-dfb3-40e6-b379-4542d769b70a'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.254955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] The token cache is being invalidate because project f5230e72e79648a3a164ac7ca19d8bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:20.255244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.257261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8664496e-dfb3-40e6-b379-4542d769b70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.259159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 808/1607] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:20 2022] DELETE /identity/v3/projects/f5230e72e79648a3a164ac7ca19d8bdd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:20.264681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d98565-4bfa-414a-83d4-6c7c8be8820f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.264922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d98565-4bfa-414a-83d4-6c7c8be8820f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.265199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d98565-4bfa-414a-83d4-6c7c8be8820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.267787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0239dd35f8d74632b1793b9c1365fa88'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.277855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0239dd35f8d74632b1793b9c1365fa88'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.290964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a3d98565-4bfa-414a-83d4-6c7c8be8820f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:20.292798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a3d98565-4bfa-414a-83d4-6c7c8be8820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:20.302481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:20.308812 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0239dd35f8d74632b1793b9c1365fa88'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.310714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0239dd35f8d74632b1793b9c1365fa88'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.311461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dc7edaa-0b9f-4cf0-ae5a-efec5934d43a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0239dd35f8d74632b1793b9c1365fa88'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:20.331764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 800/1608] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:20 2022] DELETE /identity/v3/users/0239dd35f8d74632b1793b9c1365fa88 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:20.333256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de4d61-4535-413f-bda5-eb021bade193 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.333645 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de4d61-4535-413f-bda5-eb021bade193 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.334477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de4d61-4535-413f-bda5-eb021bade193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.361100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c4de4d61-4535-413f-bda5-eb021bade193 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:20.362096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c4de4d61-4535-413f-bda5-eb021bade193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:20.411014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 809/1609] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:20.415619 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb58f4-7a77-4fba-a1b0-6a9e7b587e9c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.416389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb58f4-7a77-4fba-a1b0-6a9e7b587e9c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.417310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb58f4-7a77-4fba-a1b0-6a9e7b587e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.442704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 801/1610] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:20.443973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de4d61-4535-413f-bda5-eb021bade193 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.454480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de4d61-4535-413f-bda5-eb021bade193 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.460574 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-affb58f4-7a77-4fba-a1b0-6a9e7b587e9c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:20.462269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-affb58f4-7a77-4fba-a1b0-6a9e7b587e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:20.464238 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe57b5e-e6ee-4914-8e8a-7a81e15b0223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.465010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe57b5e-e6ee-4914-8e8a-7a81e15b0223 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.466473 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe57b5e-e6ee-4914-8e8a-7a81e15b0223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.466849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe57b5e-e6ee-4914-8e8a-7a81e15b0223 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.468183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe57b5e-e6ee-4914-8e8a-7a81e15b0223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:20.470751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe57b5e-e6ee-4914-8e8a-7a81e15b0223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.475581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe57b5e-e6ee-4914-8e8a-7a81e15b0223 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.481418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 810/1611] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:20.482884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be360-617e-403c-af23-dc603cb6a693 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.483166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be360-617e-403c-af23-dc603cb6a693 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.483501 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be360-617e-403c-af23-dc603cb6a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.509645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b33be360-617e-403c-af23-dc603cb6a693 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:20.512418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b33be360-617e-403c-af23-dc603cb6a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:20.525441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 811/1612] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:20.526410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be360-617e-403c-af23-dc603cb6a693 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.528353 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b33be360-617e-403c-af23-dc603cb6a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:20.530647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 802/1613] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:20.531352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe57b5e-e6ee-4914-8e8a-7a81e15b0223 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.564782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe57b5e-e6ee-4914-8e8a-7a81e15b0223 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.577035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8b1eb-83f0-4b50-83d8-790ef8f023be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.577666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8b1eb-83f0-4b50-83d8-790ef8f023be admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.579882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8b1eb-83f0-4b50-83d8-790ef8f023be admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.580250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8b1eb-83f0-4b50-83d8-790ef8f023be admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.582274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8b1eb-83f0-4b50-83d8-790ef8f023be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:20.582615 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8b1eb-83f0-4b50-83d8-790ef8f023be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.587292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8b1eb-83f0-4b50-83d8-790ef8f023be admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.622343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be360-617e-403c-af23-dc603cb6a693 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.626910 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da31ef0-9d52-442c-b5ca-f396e15d6f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.628925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31ef0-9d52-442c-b5ca-f396e15d6f87 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.630880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31ef0-9d52-442c-b5ca-f396e15d6f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.631170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31ef0-9d52-442c-b5ca-f396e15d6f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.646128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 803/1614] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:20.646128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8b1eb-83f0-4b50-83d8-790ef8f023be admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.654120 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da31ef0-9d52-442c-b5ca-f396e15d6f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.655909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da31ef0-9d52-442c-b5ca-f396e15d6f87 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.670766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 812/1615] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:20.672016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da31ef0-9d52-442c-b5ca-f396e15d6f87 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.679776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8b1eb-83f0-4b50-83d8-790ef8f023be admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.687972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da31ef0-9d52-442c-b5ca-f396e15d6f87 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.696564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b3c3c-1b0e-4bf7-b51c-b89051969370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.697580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3c3c-1b0e-4bf7-b51c-b89051969370 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.697817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3c3c-1b0e-4bf7-b51c-b89051969370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.698394 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3c3c-1b0e-4bf7-b51c-b89051969370 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.699277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b3c3c-1b0e-4bf7-b51c-b89051969370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.702003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03841ab-a483-4aa0-b1fa-b9f46eb1ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.702857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03841ab-a483-4aa0-b1fa-b9f46eb1ff72 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.702958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03841ab-a483-4aa0-b1fa-b9f46eb1ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.703150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03841ab-a483-4aa0-b1fa-b9f46eb1ff72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.703797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03841ab-a483-4aa0-b1fa-b9f46eb1ff72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.704227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b3c3c-1b0e-4bf7-b51c-b89051969370 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.709902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03841ab-a483-4aa0-b1fa-b9f46eb1ff72 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.759028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 804/1616] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/projects => generated 407 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:20.763814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03841ab-a483-4aa0-b1fa-b9f46eb1ff72 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.778410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 813/1617] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:20.779431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b3c3c-1b0e-4bf7-b51c-b89051969370 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.792572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:20.894501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03841ab-a483-4aa0-b1fa-b9f46eb1ff72 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.920211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b3c3c-1b0e-4bf7-b51c-b89051969370 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.926918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117129b-1131-43a6-883e-d9544d01371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.927652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117129b-1131-43a6-883e-d9544d01371f admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.927939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117129b-1131-43a6-883e-d9544d01371f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.928216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117129b-1131-43a6-883e-d9544d01371f admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.928959 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117129b-1131-43a6-883e-d9544d01371f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.932405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117129b-1131-43a6-883e-d9544d01371f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.956902 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 814/1618] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:20.961041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117129b-1131-43a6-883e-d9544d01371f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:20.969289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59214f0-1e91-421d-84b6-e5ab032cf3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.970046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59214f0-1e91-421d-84b6-e5ab032cf3bb admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.970425 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59214f0-1e91-421d-84b6-e5ab032cf3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.970786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59214f0-1e91-421d-84b6-e5ab032cf3bb admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.971298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117129b-1131-43a6-883e-d9544d01371f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:20.971556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59214f0-1e91-421d-84b6-e5ab032cf3bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.973626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59214f0-1e91-421d-84b6-e5ab032cf3bb admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.976693 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372d69-e3de-4c96-bd46-9f72b47f6b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:20.977381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372d69-e3de-4c96-bd46-9f72b47f6b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:20.977735 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372d69-e3de-4c96-bd46-9f72b47f6b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:20.978405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372d69-e3de-4c96-bd46-9f72b47f6b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:20.978813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9372d69-e3de-4c96-bd46-9f72b47f6b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:20.980806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9372d69-e3de-4c96-bd46-9f72b47f6b0e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:20.991981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:20.996222 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 815/1619] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:20.998519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 805/1620] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:20 2022] POST /identity/v3/users => generated 304 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:21.002487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372d69-e3de-4c96-bd46-9f72b47f6b0e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.003684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59214f0-1e91-421d-84b6-e5ab032cf3bb admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.015604 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372d69-e3de-4c96-bd46-9f72b47f6b0e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.021836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41f977-5c87-48e2-87c8-2835dcfa022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.022586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41f977-5c87-48e2-87c8-2835dcfa022b admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.022973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41f977-5c87-48e2-87c8-2835dcfa022b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.023469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41f977-5c87-48e2-87c8-2835dcfa022b admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.024225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41f977-5c87-48e2-87c8-2835dcfa022b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.024693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59214f0-1e91-421d-84b6-e5ab032cf3bb admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.026072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41f977-5c87-48e2-87c8-2835dcfa022b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.030488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40bba-3db9-4e9b-a463-97d9329f9cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.031487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40bba-3db9-4e9b-a463-97d9329f9cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.031901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40bba-3db9-4e9b-a463-97d9329f9cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.032333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40bba-3db9-4e9b-a463-97d9329f9cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.033146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e40bba-3db9-4e9b-a463-97d9329f9cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.034899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e40bba-3db9-4e9b-a463-97d9329f9cf4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.038595 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 816/1621] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:21.042800 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41f977-5c87-48e2-87c8-2835dcfa022b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.051025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 806/1622] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:21.052055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40bba-3db9-4e9b-a463-97d9329f9cf4 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.054207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41f977-5c87-48e2-87c8-2835dcfa022b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.060209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681302f-ccfd-4021-a349-b13ed6a90340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.061435 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681302f-ccfd-4021-a349-b13ed6a90340 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.061769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681302f-ccfd-4021-a349-b13ed6a90340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.061989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681302f-ccfd-4021-a349-b13ed6a90340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.062655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681302f-ccfd-4021-a349-b13ed6a90340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.064421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681302f-ccfd-4021-a349-b13ed6a90340 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.065065 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40bba-3db9-4e9b-a463-97d9329f9cf4 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.070286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4d96c-9d7b-49da-a62c-dee276d91312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.071240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d96c-9d7b-49da-a62c-dee276d91312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.071719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d96c-9d7b-49da-a62c-dee276d91312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.072145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d96c-9d7b-49da-a62c-dee276d91312 admin admin] PATH_INFO: `/v3/projects/8a4ffea4c51c493bb40d3de74632f5b6/users/34e11df13fd84bb1874048f31d4353b2/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.080507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 817/1623] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:21.081518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681302f-ccfd-4021-a349-b13ed6a90340 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.090493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4d96c-9d7b-49da-a62c-dee276d91312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4ffea4c51c493bb40d3de74632f5b6, user_id=34e11df13fd84bb1874048f31d4353b2, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.098245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681302f-ccfd-4021-a349-b13ed6a90340 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.098783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4d96c-9d7b-49da-a62c-dee276d91312 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.104359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61f999-0c9f-46dc-acb0-b8efd01448ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.105424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61f999-0c9f-46dc-acb0-b8efd01448ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.105802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61f999-0c9f-46dc-acb0-b8efd01448ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.106191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61f999-0c9f-46dc-acb0-b8efd01448ae admin admin] PATH_INFO: `/v3/projects/7403aec5888444c58881330c0e33d5d4/users/19194e2358a9431c9ac8173a503f365b/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.125451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61f999-0c9f-46dc-acb0-b8efd01448ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7403aec5888444c58881330c0e33d5d4, user_id=19194e2358a9431c9ac8173a503f365b, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.128189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61f999-0c9f-46dc-acb0-b8efd01448ae admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.128347 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 807/1624] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:21 2022] PUT /identity/v3/projects/8a4ffea4c51c493bb40d3de74632f5b6/users/34e11df13fd84bb1874048f31d4353b2/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:21.139830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d4264-a176-402c-b9b6-bce74933e905 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.140112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d4264-a176-402c-b9b6-bce74933e905 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.140419 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d4264-a176-402c-b9b6-bce74933e905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.144931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 818/1625] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:21 2022] PUT /identity/v3/projects/7403aec5888444c58881330c0e33d5d4/users/19194e2358a9431c9ac8173a503f365b/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:21.163467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680601c-6027-4ace-97c7-bb20a5d65b54 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.163467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680601c-6027-4ace-97c7-bb20a5d65b54 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.163467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680601c-6027-4ace-97c7-bb20a5d65b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.175773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-aa5d4264-a176-402c-b9b6-bce74933e905 None None] MFA Rules not processed for user `34e11df13fd84bb1874048f31d4353b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:21.177173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-aa5d4264-a176-402c-b9b6-bce74933e905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.234747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c680601c-6027-4ace-97c7-bb20a5d65b54 None None] MFA Rules not processed for user `19194e2358a9431c9ac8173a503f365b`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:21.236551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c680601c-6027-4ace-97c7-bb20a5d65b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.291984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 808/1626] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:21.292723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d4264-a176-402c-b9b6-bce74933e905 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.293996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-aa5d4264-a176-402c-b9b6-bce74933e905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.299819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:21.342590 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 819/1627] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:21.343715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680601c-6027-4ace-97c7-bb20a5d65b54 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.367034 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d4264-a176-402c-b9b6-bce74933e905 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.372453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.373085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.373360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.373626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] PATH_INFO: `/v3/projects/2967e0c2f33747e8a60f25a12d12a3ec` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.375562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2967e0c2f33747e8a60f25a12d12a3ec)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.377555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.418704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680601c-6027-4ace-97c7-bb20a5d65b54 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.428521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2967e0c2f33747e8a60f25a12d12a3ec', 'request_id': 'req-f8f82ffa-d40e-43a9-9aab-baee6e00a405'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:21.439655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2967e0c2f33747e8a60f25a12d12a3ec', 'request_id': 'req-f8f82ffa-d40e-43a9-9aab-baee6e00a405'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:21.446944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2967e0c2f33747e8a60f25a12d12a3ec', 'request_id': 'req-f8f82ffa-d40e-43a9-9aab-baee6e00a405'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:21.458562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] The token cache is being invalidate because project 2967e0c2f33747e8a60f25a12d12a3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:21.459140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:21.459907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:21.461620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 809/1628] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:21 2022] DELETE /identity/v3/projects/2967e0c2f33747e8a60f25a12d12a3ec => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:21.465761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.465761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.470920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:21.484059 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9bd2d-368a-45e9-bd15-c0e09249a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.485119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9bd2d-368a-45e9-bd15-c0e09249a8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.485523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9bd2d-368a-45e9-bd15-c0e09249a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.485677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9bd2d-368a-45e9-bd15-c0e09249a8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.486702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9bd2d-368a-45e9-bd15-c0e09249a8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.489318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9bd2d-368a-45e9-bd15-c0e09249a8d5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.525639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 820/1629] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:21.525639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf293b-e30c-4865-b859-885ec66a097e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.525639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf293b-e30c-4865-b859-885ec66a097e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.525639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf293b-e30c-4865-b859-885ec66a097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.541562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f82ffa-d40e-43a9-9aab-baee6e00a405 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.547319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5fbf293b-e30c-4865-b859-885ec66a097e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:21.548542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5fbf293b-e30c-4865-b859-885ec66a097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.601951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:21.628450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 821/1630] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:21.629836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf293b-e30c-4865-b859-885ec66a097e None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.631093 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f7fc1-758b-4d96-aaf0-f8b23b88d1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.631427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5fbf293b-e30c-4865-b859-885ec66a097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.631746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f7fc1-758b-4d96-aaf0-f8b23b88d1df admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.632049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f7fc1-758b-4d96-aaf0-f8b23b88d1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.632346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f7fc1-758b-4d96-aaf0-f8b23b88d1df admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.632992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f7fc1-758b-4d96-aaf0-f8b23b88d1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.634896 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f7fc1-758b-4d96-aaf0-f8b23b88d1df admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.643991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf293b-e30c-4865-b859-885ec66a097e None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.649066 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32c86c-764a-48cc-93cc-cc5601eb3cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.649685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c86c-764a-48cc-93cc-cc5601eb3cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.649966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c86c-764a-48cc-93cc-cc5601eb3cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.650243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c86c-764a-48cc-93cc-cc5601eb3cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.650890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32c86c-764a-48cc-93cc-cc5601eb3cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.652897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32c86c-764a-48cc-93cc-cc5601eb3cb4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.669123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 810/1631] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/projects => generated 409 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:21.670786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3adb-186f-4cfe-8db1-46f13c69a59a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.671170 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3adb-186f-4cfe-8db1-46f13c69a59a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.671955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3adb-186f-4cfe-8db1-46f13c69a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.683018 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 822/1632] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:21.683018 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32c86c-764a-48cc-93cc-cc5601eb3cb4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.698291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-cf1e3adb-186f-4cfe-8db1-46f13c69a59a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:21.700440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cf1e3adb-186f-4cfe-8db1-46f13c69a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.713132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32c86c-764a-48cc-93cc-cc5601eb3cb4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.775893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 811/1633] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:21.777183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e3adb-186f-4cfe-8db1-46f13c69a59a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.794326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e3adb-186f-4cfe-8db1-46f13c69a59a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.799499 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66c769-3577-4a2a-9f7b-07e45774cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.800400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66c769-3577-4a2a-9f7b-07e45774cb25 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.800774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66c769-3577-4a2a-9f7b-07e45774cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.801152 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66c769-3577-4a2a-9f7b-07e45774cb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.801916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66c769-3577-4a2a-9f7b-07e45774cb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.803590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66c769-3577-4a2a-9f7b-07e45774cb25 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.814808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 812/1634] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:21.815573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66c769-3577-4a2a-9f7b-07e45774cb25 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.830305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66c769-3577-4a2a-9f7b-07e45774cb25 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.838933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcd2cd-180c-4b76-bf24-7d097d8c5134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.839617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcd2cd-180c-4b76-bf24-7d097d8c5134 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.842895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcd2cd-180c-4b76-bf24-7d097d8c5134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.843011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcd2cd-180c-4b76-bf24-7d097d8c5134 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.843506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722f0d0-6589-49de-924e-480c94b3681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.844165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcd2cd-180c-4b76-bf24-7d097d8c5134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.846456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcd2cd-180c-4b76-bf24-7d097d8c5134 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.848467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722f0d0-6589-49de-924e-480c94b3681f admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.848953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722f0d0-6589-49de-924e-480c94b3681f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.851817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722f0d0-6589-49de-924e-480c94b3681f admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.854180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722f0d0-6589-49de-924e-480c94b3681f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:21.854496 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722f0d0-6589-49de-924e-480c94b3681f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.856119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722f0d0-6589-49de-924e-480c94b3681f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.902440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 813/1635] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:21.904561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722f0d0-6589-49de-924e-480c94b3681f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.907822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 823/1636] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/users => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:21.908872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcd2cd-180c-4b76-bf24-7d097d8c5134 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:21.909436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c722f0d0-6589-49de-924e-480c94b3681f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:21.931950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722f0d0-6589-49de-924e-480c94b3681f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.934529 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcd2cd-180c-4b76-bf24-7d097d8c5134 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:21.938261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.938957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.939234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.939502 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] PATH_INFO: `/v3/users/dc385d15775c4d4abfc9610271ddf523` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.941039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc385d15775c4d4abfc9610271ddf523)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.941599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20de537-1d14-43f4-b3f1-a85a66e44a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:21.943028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.943363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20de537-1d14-43f4-b3f1-a85a66e44a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:21.943754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20de537-1d14-43f4-b3f1-a85a66e44a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:21.944129 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20de537-1d14-43f4-b3f1-a85a66e44a5c admin admin] PATH_INFO: `/v3/projects/89db818bd8534dd98617f2988f466cce/users/1500f40da9bb4de088905e43979916a2/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:21.969921 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20de537-1d14-43f4-b3f1-a85a66e44a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89db818bd8534dd98617f2988f466cce, user_id=1500f40da9bb4de088905e43979916a2, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:21.979489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20de537-1d14-43f4-b3f1-a85a66e44a5c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:21.998963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 824/1637] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:21 2022] PUT /identity/v3/projects/89db818bd8534dd98617f2988f466cce/users/1500f40da9bb4de088905e43979916a2/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:22.000127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20de537-1d14-43f4-b3f1-a85a66e44a5c admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.009948 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc385d15775c4d4abfc9610271ddf523'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:22.028170 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc385d15775c4d4abfc9610271ddf523'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:22.036269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:22.054917 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc385d15775c4d4abfc9610271ddf523'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:22.055687 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc385d15775c4d4abfc9610271ddf523'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:22.056537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc385d15775c4d4abfc9610271ddf523'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:22.081882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 814/1638] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:21 2022] DELETE /identity/v3/users/dc385d15775c4d4abfc9610271ddf523 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:22.082749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.084348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:22.089861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20de537-1d14-43f4-b3f1-a85a66e44a5c admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.101351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:22.168525 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79e464-b2e5-46bc-9108-467d30745c02 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.175685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c786c-abf2-4db9-a722-8dc58bd99854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.176963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c786c-abf2-4db9-a722-8dc58bd99854 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.178337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c786c-abf2-4db9-a722-8dc58bd99854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.178746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c786c-abf2-4db9-a722-8dc58bd99854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.180089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c786c-abf2-4db9-a722-8dc58bd99854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.182680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a7bfc-bce5-4572-b3b0-0489d5469111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.184013 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c786c-abf2-4db9-a722-8dc58bd99854 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.184915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7bfc-bce5-4572-b3b0-0489d5469111 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.185351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7bfc-bce5-4572-b3b0-0489d5469111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.185723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7bfc-bce5-4572-b3b0-0489d5469111 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.187255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a7bfc-bce5-4572-b3b0-0489d5469111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.189897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a7bfc-bce5-4572-b3b0-0489d5469111 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.204688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 815/1639] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:22.205770 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c786c-abf2-4db9-a722-8dc58bd99854 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.209287 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a28c786c-abf2-4db9-a722-8dc58bd99854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:22.224895 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c786c-abf2-4db9-a722-8dc58bd99854 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.230589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54c396-79eb-4fc9-a12f-8c473f1363cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.231297 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c396-79eb-4fc9-a12f-8c473f1363cf admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.231583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c396-79eb-4fc9-a12f-8c473f1363cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.234694 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c396-79eb-4fc9-a12f-8c473f1363cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.234801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 825/1640] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:21 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:22.234880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54c396-79eb-4fc9-a12f-8c473f1363cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.234964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5af9-13a2-4647-80b7-054b34cf3210 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.234964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5af9-13a2-4647-80b7-054b34cf3210 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.234964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5af9-13a2-4647-80b7-054b34cf3210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.235194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54c396-79eb-4fc9-a12f-8c473f1363cf admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.250220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 816/1641] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:22.250220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54c396-79eb-4fc9-a12f-8c473f1363cf admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.260781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54c396-79eb-4fc9-a12f-8c473f1363cf admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.260910 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-03bd5af9-13a2-4647-80b7-054b34cf3210 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:22.262388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-03bd5af9-13a2-4647-80b7-054b34cf3210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:22.352832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efc0da-8d55-43d0-be07-b19b267bf713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.358973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efc0da-8d55-43d0-be07-b19b267bf713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.358973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efc0da-8d55-43d0-be07-b19b267bf713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.358973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efc0da-8d55-43d0-be07-b19b267bf713 admin admin] PATH_INFO: `/v3/projects/f0c37b3a50db4fe7beef23b4e46a8952/users/b41e51004f794a58aafd06c68c05c856/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.396661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efc0da-8d55-43d0-be07-b19b267bf713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c37b3a50db4fe7beef23b4e46a8952, user_id=b41e51004f794a58aafd06c68c05c856, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.401106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efc0da-8d55-43d0-be07-b19b267bf713 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.412936 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 826/1642] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:22.414103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd5af9-13a2-4647-80b7-054b34cf3210 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.415688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-03bd5af9-13a2-4647-80b7-054b34cf3210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:22.436924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 817/1643] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:22 2022] PUT /identity/v3/projects/f0c37b3a50db4fe7beef23b4e46a8952/users/b41e51004f794a58aafd06c68c05c856/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:22.437559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efc0da-8d55-43d0-be07-b19b267bf713 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.443174 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd5af9-13a2-4647-80b7-054b34cf3210 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.558698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efc0da-8d55-43d0-be07-b19b267bf713 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.562895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:22.565903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c0167-2496-4f99-8a0a-6466e0a4df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.566590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0167-2496-4f99-8a0a-6466e0a4df6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.566876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0167-2496-4f99-8a0a-6466e0a4df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.567153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0167-2496-4f99-8a0a-6466e0a4df6a admin admin] PATH_INFO: `/v3/projects/89db818bd8534dd98617f2988f466cce/users/1500f40da9bb4de088905e43979916a2/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.569575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c0167-2496-4f99-8a0a-6466e0a4df6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=89db818bd8534dd98617f2988f466cce, user_id=1500f40da9bb4de088905e43979916a2, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.572746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c0167-2496-4f99-8a0a-6466e0a4df6a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.575994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0354d1e-f5c0-4276-8170-96dedf108fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.577474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0354d1e-f5c0-4276-8170-96dedf108fcf admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.578088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0354d1e-f5c0-4276-8170-96dedf108fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.578432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0354d1e-f5c0-4276-8170-96dedf108fcf admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.579151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0354d1e-f5c0-4276-8170-96dedf108fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.582571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0354d1e-f5c0-4276-8170-96dedf108fcf admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.592645 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 818/1644] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:22 2022] PUT /identity/v3/projects/89db818bd8534dd98617f2988f466cce/users/1500f40da9bb4de088905e43979916a2/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:22.594790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c0167-2496-4f99-8a0a-6466e0a4df6a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.604308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-095c0167-2496-4f99-8a0a-6466e0a4df6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:22.622565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 827/1645] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:22 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:22.623486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0354d1e-f5c0-4276-8170-96dedf108fcf admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.631628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:22.634501 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0354d1e-f5c0-4276-8170-96dedf108fcf admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.684286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c0167-2496-4f99-8a0a-6466e0a4df6a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.693163 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7388a-0df1-4c36-ad78-c221a4239383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.694666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7388a-0df1-4c36-ad78-c221a4239383 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.694969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7388a-0df1-4c36-ad78-c221a4239383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.695330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7388a-0df1-4c36-ad78-c221a4239383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.705538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee9da9-85ff-4c70-ae95-3035cc3c16a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.706167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9da9-85ff-4c70-ae95-3035cc3c16a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.706586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9da9-85ff-4c70-ae95-3035cc3c16a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.706870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9da9-85ff-4c70-ae95-3035cc3c16a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.708163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee9da9-85ff-4c70-ae95-3035cc3c16a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.710031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee9da9-85ff-4c70-ae95-3035cc3c16a1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.722384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 828/1646] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:22.724116 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a809e-7aa9-4128-b09b-bedb0a0f9dae None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.724493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a809e-7aa9-4128-b09b-bedb0a0f9dae None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.724840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a809e-7aa9-4128-b09b-bedb0a0f9dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.759939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-3b8a809e-7aa9-4128-b09b-bedb0a0f9dae None None] MFA Rules not processed for user `1500f40da9bb4de088905e43979916a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:22.761329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3b8a809e-7aa9-4128-b09b-bedb0a0f9dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:22.772791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7388a-0df1-4c36-ad78-c221a4239383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.774542 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7388a-0df1-4c36-ad78-c221a4239383 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.787570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 819/1647] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:22.789548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7388a-0df1-4c36-ad78-c221a4239383 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.800499 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7388a-0df1-4c36-ad78-c221a4239383 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.825069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba707b70-a7a2-45ea-9000-666c80dfacb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.826854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba707b70-a7a2-45ea-9000-666c80dfacb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.828211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba707b70-a7a2-45ea-9000-666c80dfacb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.828708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba707b70-a7a2-45ea-9000-666c80dfacb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.830154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba707b70-a7a2-45ea-9000-666c80dfacb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.836400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba707b70-a7a2-45ea-9000-666c80dfacb6 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.865111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 820/1648] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:22.866116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba707b70-a7a2-45ea-9000-666c80dfacb6 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.882584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba707b70-a7a2-45ea-9000-666c80dfacb6 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.889454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81426bb-4e9e-4c88-81bd-ec25b99a7179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:22.891348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81426bb-4e9e-4c88-81bd-ec25b99a7179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:22.891603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81426bb-4e9e-4c88-81bd-ec25b99a7179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:22.891984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81426bb-4e9e-4c88-81bd-ec25b99a7179 admin admin] PATH_INFO: `/v3/projects/f0c37b3a50db4fe7beef23b4e46a8952/users/b41e51004f794a58aafd06c68c05c856/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:22.895043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81426bb-4e9e-4c88-81bd-ec25b99a7179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c37b3a50db4fe7beef23b4e46a8952, user_id=b41e51004f794a58aafd06c68c05c856, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:22.897487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 829/1649] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:22.898210 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81426bb-4e9e-4c88-81bd-ec25b99a7179 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:22.900508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a809e-7aa9-4128-b09b-bedb0a0f9dae None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.924451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 821/1650] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:22 2022] PUT /identity/v3/projects/f0c37b3a50db4fe7beef23b4e46a8952/users/b41e51004f794a58aafd06c68c05c856/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:22.925460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81426bb-4e9e-4c88-81bd-ec25b99a7179 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:22.925882 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a809e-7aa9-4128-b09b-bedb0a0f9dae None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:22.927580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b81426bb-4e9e-4c88-81bd-ec25b99a7179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.021835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81426bb-4e9e-4c88-81bd-ec25b99a7179 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:23.025895 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb05c9-feae-4d71-8a3b-2f3f3cb4251a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.026627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb05c9-feae-4d71-8a3b-2f3f3cb4251a service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.026900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb05c9-feae-4d71-8a3b-2f3f3cb4251a service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.027170 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb05c9-feae-4d71-8a3b-2f3f3cb4251a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.029002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2beb05c9-feae-4d71-8a3b-2f3f3cb4251a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.063452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aee5d6-7151-4208-9d2a-df0e12ed6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.064520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aee5d6-7151-4208-9d2a-df0e12ed6230 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.064802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aee5d6-7151-4208-9d2a-df0e12ed6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.065078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aee5d6-7151-4208-9d2a-df0e12ed6230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.065901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aee5d6-7151-4208-9d2a-df0e12ed6230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:23.067901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aee5d6-7151-4208-9d2a-df0e12ed6230 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:23.081470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 830/1651] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:23.082726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6173f-4f09-4b8d-a128-bce5eb093974 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.083019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6173f-4f09-4b8d-a128-bce5eb093974 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.083295 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6173f-4f09-4b8d-a128-bce5eb093974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.091876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:23.109684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:23.113518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb05c9-feae-4d71-8a3b-2f3f3cb4251a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:23.116131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb05c9-feae-4d71-8a3b-2f3f3cb4251a service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:23.130583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-58e6173f-4f09-4b8d-a128-bce5eb093974 None None] MFA Rules not processed for user `b41e51004f794a58aafd06c68c05c856`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:23.132061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-58e6173f-4f09-4b8d-a128-bce5eb093974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.133874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 822/1652] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:23.135202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb05c9-feae-4d71-8a3b-2f3f3cb4251a service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:23.149039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb05c9-feae-4d71-8a3b-2f3f3cb4251a service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:23.154262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5b05d-8887-4aa6-941c-b74f46b6a656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.155136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5b05d-8887-4aa6-941c-b74f46b6a656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.155623 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5b05d-8887-4aa6-941c-b74f46b6a656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.155997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5b05d-8887-4aa6-941c-b74f46b6a656 admin admin] PATH_INFO: `/v3/projects/31ca7a7fcfd74033bd8228adf26ea0eb/users/e422b50b0ead4b9e837ac893300b0be0/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.175951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5b05d-8887-4aa6-941c-b74f46b6a656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ca7a7fcfd74033bd8228adf26ea0eb, user_id=e422b50b0ead4b9e837ac893300b0be0, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:23.179517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5b05d-8887-4aa6-941c-b74f46b6a656 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:23.196947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 823/1653] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:23 2022] PUT /identity/v3/projects/31ca7a7fcfd74033bd8228adf26ea0eb/users/e422b50b0ead4b9e837ac893300b0be0/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:23.202215 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f641b-65bb-409f-8b67-57a734700786 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.203038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f641b-65bb-409f-8b67-57a734700786 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.203038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f641b-65bb-409f-8b67-57a734700786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.248180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e85f641b-65bb-409f-8b67-57a734700786 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:23.249896 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e85f641b-65bb-409f-8b67-57a734700786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.265559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 831/1654] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:23.276766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6173f-4f09-4b8d-a128-bce5eb093974 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:23.278377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-58e6173f-4f09-4b8d-a128-bce5eb093974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.296966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6173f-4f09-4b8d-a128-bce5eb093974 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:23.393288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48e30e-4d92-4877-a2e6-06f4c10c3ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.394049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48e30e-4d92-4877-a2e6-06f4c10c3ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.394331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48e30e-4d92-4877-a2e6-06f4c10c3ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.394599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48e30e-4d92-4877-a2e6-06f4c10c3ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.417066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 824/1655] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:23.418837 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f641b-65bb-409f-8b67-57a734700786 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:23.423039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e85f641b-65bb-409f-8b67-57a734700786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.455146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f641b-65bb-409f-8b67-57a734700786 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:23.463649 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.465522 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.466044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.466608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] PATH_INFO: `/v3/projects/33d65913fb2844789353a6d86177be04` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.468808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d65913fb2844789353a6d86177be04)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:23.471416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:23.504109 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48e30e-4d92-4877-a2e6-06f4c10c3ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:23.506235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48e30e-4d92-4877-a2e6-06f4c10c3ef9 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:23.525388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 832/1656] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:23.527813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48e30e-4d92-4877-a2e6-06f4c10c3ef9 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:23.597977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d65913fb2844789353a6d86177be04', 'request_id': 'req-4fda4945-a06a-48a8-a940-4518d11fa66b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.620372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d65913fb2844789353a6d86177be04', 'request_id': 'req-4fda4945-a06a-48a8-a940-4518d11fa66b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.631533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:23.638679 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d65913fb2844789353a6d86177be04', 'request_id': 'req-4fda4945-a06a-48a8-a940-4518d11fa66b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.667598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48e30e-4d92-4877-a2e6-06f4c10c3ef9 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:23.670184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] The token cache is being invalidate because project 33d65913fb2844789353a6d86177be04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:23.670404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.673881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4fda4945-a06a-48a8-a940-4518d11fa66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:23.675606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 825/1657] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:23 2022] DELETE /identity/v3/projects/33d65913fb2844789353a6d86177be04 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:23.684703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af3fb-948a-43df-be6a-14b00ec893fe None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.685136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af3fb-948a-43df-be6a-14b00ec893fe None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.686030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af3fb-948a-43df-be6a-14b00ec893fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.746236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-262af3fb-948a-43df-be6a-14b00ec893fe None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:23.747461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-262af3fb-948a-43df-be6a-14b00ec893fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.793115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68832117-227f-4115-afc4-0cbbc48654d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.793945 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68832117-227f-4115-afc4-0cbbc48654d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.794373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68832117-227f-4115-afc4-0cbbc48654d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.794658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68832117-227f-4115-afc4-0cbbc48654d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.796881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-68832117-227f-4115-afc4-0cbbc48654d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.886567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:23.902865 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 826/1658] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:23.904136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af3fb-948a-43df-be6a-14b00ec893fe None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:23.904544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68832117-227f-4115-afc4-0cbbc48654d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:23.905831 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-262af3fb-948a-43df-be6a-14b00ec893fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.906004 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68832117-227f-4115-afc4-0cbbc48654d9 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:23.918624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 833/1659] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:23.920017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82be09a-cb91-4a9a-9f9f-6da7d69a6500 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.920364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82be09a-cb91-4a9a-9f9f-6da7d69a6500 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.920972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82be09a-cb91-4a9a-9f9f-6da7d69a6500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.947010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-f82be09a-cb91-4a9a-9f9f-6da7d69a6500 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:23.949668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f82be09a-cb91-4a9a-9f9f-6da7d69a6500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.966337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 834/1660] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:23.970525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82be09a-cb91-4a9a-9f9f-6da7d69a6500 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:23.979195 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af3fb-948a-43df-be6a-14b00ec893fe None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:23.981817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82be09a-cb91-4a9a-9f9f-6da7d69a6500 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:23.983523 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573fcc-46ac-48c5-8887-1277012aa419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.984374 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573fcc-46ac-48c5-8887-1277012aa419 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.984733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573fcc-46ac-48c5-8887-1277012aa419 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.985010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573fcc-46ac-48c5-8887-1277012aa419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.987596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-60573fcc-46ac-48c5-8887-1277012aa419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:23.989946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592665-7afb-4cda-a0cb-c225ff2d1ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:23.990573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592665-7afb-4cda-a0cb-c225ff2d1ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:23.990847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592665-7afb-4cda-a0cb-c225ff2d1ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:23.991131 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592665-7afb-4cda-a0cb-c225ff2d1ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:23.994380 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a592665-7afb-4cda-a0cb-c225ff2d1ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:23.994776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a592665-7afb-4cda-a0cb-c225ff2d1ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:23.999267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a592665-7afb-4cda-a0cb-c225ff2d1ff5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.057935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 835/1661] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:13:24.063686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592665-7afb-4cda-a0cb-c225ff2d1ff5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:24.065935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60573fcc-46ac-48c5-8887-1277012aa419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.068158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60573fcc-46ac-48c5-8887-1277012aa419 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.081009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 827/1662] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:24.103403 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592665-7afb-4cda-a0cb-c225ff2d1ff5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:24.123067 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7458e-3a0f-4312-b015-004419cf0a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:24.123769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7458e-3a0f-4312-b015-004419cf0a92 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.123968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7458e-3a0f-4312-b015-004419cf0a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.124237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7458e-3a0f-4312-b015-004419cf0a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.130064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7458e-3a0f-4312-b015-004419cf0a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.139788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7458e-3a0f-4312-b015-004419cf0a92 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.221683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 836/1663] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:24 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:24.222681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573fcc-46ac-48c5-8887-1277012aa419 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:24.240561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573fcc-46ac-48c5-8887-1277012aa419 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:24.442607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e0b94-89e8-40a4-b235-a5b754204db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:24.443310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e0b94-89e8-40a4-b235-a5b754204db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.443658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e0b94-89e8-40a4-b235-a5b754204db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.444007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e0b94-89e8-40a4-b235-a5b754204db1 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.444803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e0b94-89e8-40a4-b235-a5b754204db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.448098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e0b94-89e8-40a4-b235-a5b754204db1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.503525 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 828/1664] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:24 2022] POST /identity/v3/users => generated 296 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:24.508091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7458e-3a0f-4312-b015-004419cf0a92 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:24.530571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7458e-3a0f-4312-b015-004419cf0a92 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:24.544483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db6ab1-2fb9-41ae-a0f3-93ae35b8ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:24.546298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db6ab1-2fb9-41ae-a0f3-93ae35b8ca07 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.546579 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db6ab1-2fb9-41ae-a0f3-93ae35b8ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.546849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db6ab1-2fb9-41ae-a0f3-93ae35b8ca07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.548561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db6ab1-2fb9-41ae-a0f3-93ae35b8ca07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.552632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db6ab1-2fb9-41ae-a0f3-93ae35b8ca07 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.590303 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e0b94-89e8-40a4-b235-a5b754204db1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:24.591105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 837/1665] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:24.607249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e0b94-89e8-40a4-b235-a5b754204db1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:24.621725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a888d-baa0-404f-a531-60179a590a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:24.623367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a888d-baa0-404f-a531-60179a590a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.624631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a888d-baa0-404f-a531-60179a590a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.625495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a888d-baa0-404f-a531-60179a590a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.626932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a888d-baa0-404f-a531-60179a590a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.634930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a888d-baa0-404f-a531-60179a590a66 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.652856 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 829/1666] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:24.657632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db6ab1-2fb9-41ae-a0f3-93ae35b8ca07 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:24.669667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db6ab1-2fb9-41ae-a0f3-93ae35b8ca07 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:24.675008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82526b-bf77-4900-a2c4-14c1184374c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:24.676184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82526b-bf77-4900-a2c4-14c1184374c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.676184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82526b-bf77-4900-a2c4-14c1184374c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.676531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82526b-bf77-4900-a2c4-14c1184374c4 admin admin] PATH_INFO: `/v3/projects/2b029f76c4534348955998cbcc546af7/users/c32fef3e897a49699811e87c12b6c3d3/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.699745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82526b-bf77-4900-a2c4-14c1184374c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b029f76c4534348955998cbcc546af7, user_id=c32fef3e897a49699811e87c12b6c3d3, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:24.703839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82526b-bf77-4900-a2c4-14c1184374c4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:24.740951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9b085-84c6-4e8c-8d20-f3a220b78690 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.741248 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 838/1667] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:24 2022] PUT /identity/v3/projects/2b029f76c4534348955998cbcc546af7/users/c32fef3e897a49699811e87c12b6c3d3/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:24.741781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9b085-84c6-4e8c-8d20-f3a220b78690 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.742167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9b085-84c6-4e8c-8d20-f3a220b78690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.823526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7cf9b085-84c6-4e8c-8d20-f3a220b78690 None None] MFA Rules not processed for user `c32fef3e897a49699811e87c12b6c3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:24.824933 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7cf9b085-84c6-4e8c-8d20-f3a220b78690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:24.847434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82526b-bf77-4900-a2c4-14c1184374c4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:24.881283 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:24.894303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:24.929350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82526b-bf77-4900-a2c4-14c1184374c4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:24.936239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05c99d-a179-417e-8c09-b2573253709c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:24.937040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c99d-a179-417e-8c09-b2573253709c service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:24.937392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c99d-a179-417e-8c09-b2573253709c service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:24.937958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c99d-a179-417e-8c09-b2573253709c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:24.941218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2d05c99d-a179-417e-8c09-b2573253709c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:24.992395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 830/1668] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:25.009575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9b085-84c6-4e8c-8d20-f3a220b78690 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:25.011130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7cf9b085-84c6-4e8c-8d20-f3a220b78690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:25.026879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9b085-84c6-4e8c-8d20-f3a220b78690 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:25.028477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05c99d-a179-417e-8c09-b2573253709c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:25.030542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05c99d-a179-417e-8c09-b2573253709c service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:25.032232 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eff9a-0b9e-42c9-b570-1b32eb39a5c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:25.033852 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eff9a-0b9e-42c9-b570-1b32eb39a5c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:25.034169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eff9a-0b9e-42c9-b570-1b32eb39a5c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:25.034811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eff9a-0b9e-42c9-b570-1b32eb39a5c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:25.042901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 839/1669] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:25.045117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961eff9a-0b9e-42c9-b570-1b32eb39a5c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:25.046611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961eff9a-0b9e-42c9-b570-1b32eb39a5c2 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:25.061902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 831/1670] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:25.664162 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e547c-17d6-4d3d-b161-c095f3e8c2f0 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:25.664680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e547c-17d6-4d3d-b161-c095f3e8c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:25.664835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e547c-17d6-4d3d-b161-c095f3e8c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:25.760369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-3a6e547c-17d6-4d3d-b161-c095f3e8c2f0 None None] MFA Rules not processed for user `e422b50b0ead4b9e837ac893300b0be0`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:25.761898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3a6e547c-17d6-4d3d-b161-c095f3e8c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:25.896208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 840/1671] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:25.990573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eff9a-0b9e-42c9-b570-1b32eb39a5c2 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:26.002184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eff9a-0b9e-42c9-b570-1b32eb39a5c2 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:26.016218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5170f-5add-418a-b6b2-ca428074c8be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:26.017024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5170f-5add-418a-b6b2-ca428074c8be service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:26.017533 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5170f-5add-418a-b6b2-ca428074c8be service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:26.017893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5170f-5add-418a-b6b2-ca428074c8be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:26.033803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5170f-5add-418a-b6b2-ca428074c8be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:26.035134 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5170f-5add-418a-b6b2-ca428074c8be service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:26.066756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 832/1672] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:27.524585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbf21-adbb-4586-8b45-ca9b8af46031 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:27.525550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbf21-adbb-4586-8b45-ca9b8af46031 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:27.525827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbf21-adbb-4586-8b45-ca9b8af46031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:27.546829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-47cdbf21-adbb-4586-8b45-ca9b8af46031 None None] MFA Rules not processed for user `e422b50b0ead4b9e837ac893300b0be0`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:27.548402 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-47cdbf21-adbb-4586-8b45-ca9b8af46031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:27.556716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 841/1673] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:29.137051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5170f-5add-418a-b6b2-ca428074c8be service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:29.142433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2fd5170f-5add-418a-b6b2-ca428074c8be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:29.237765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5170f-5add-418a-b6b2-ca428074c8be service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:29.245693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:29.246469 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.246890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.247187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] PATH_INFO: `/v3/users/34e11df13fd84bb1874048f31d4353b2` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.248646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e11df13fd84bb1874048f31d4353b2)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:29.251087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:29.309236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e11df13fd84bb1874048f31d4353b2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.318517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e11df13fd84bb1874048f31d4353b2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.331591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e11df13fd84bb1874048f31d4353b2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.332348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e11df13fd84bb1874048f31d4353b2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.333016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e11df13fd84bb1874048f31d4353b2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:29.351468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 833/1674] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:29 2022] DELETE /identity/v3/users/34e11df13fd84bb1874048f31d4353b2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:29.355690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417ea61-b21b-4db9-b942-cf4e291e1dae None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.356766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417ea61-b21b-4db9-b942-cf4e291e1dae None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.357275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417ea61-b21b-4db9-b942-cf4e291e1dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.382459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-1417ea61-b21b-4db9-b942-cf4e291e1dae None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:29.383893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1417ea61-b21b-4db9-b942-cf4e291e1dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:29.455503 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 842/1675] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:29.480815 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:29.482223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:29.497400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:29.544141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3623e6-82b8-42b5-9a86-1b831d5433b1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:29.547866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbb4ef-1fa4-4675-9803-2003e9c99e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:29.548578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb4ef-1fa4-4675-9803-2003e9c99e9b service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.548799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb4ef-1fa4-4675-9803-2003e9c99e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.549066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb4ef-1fa4-4675-9803-2003e9c99e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.559696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbb4ef-1fa4-4675-9803-2003e9c99e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:29.561696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbb4ef-1fa4-4675-9803-2003e9c99e9b service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:29.572621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 834/1676] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:29.955947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417ea61-b21b-4db9-b942-cf4e291e1dae None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:29.957499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1417ea61-b21b-4db9-b942-cf4e291e1dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:29.966027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:29.973967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417ea61-b21b-4db9-b942-cf4e291e1dae None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:29.979215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:29.979981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:29.980260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:29.980565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] PATH_INFO: `/v3/projects/8a4ffea4c51c493bb40d3de74632f5b6` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:29.981710 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4ffea4c51c493bb40d3de74632f5b6)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:29.983739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:29.991586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbb4ef-1fa4-4675-9803-2003e9c99e9b service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:29.993540 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-99dbb4ef-1fa4-4675-9803-2003e9c99e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.008158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbb4ef-1fa4-4675-9803-2003e9c99e9b service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.012922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.013556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.013845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.014119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] PATH_INFO: `/v3/users/19194e2358a9431c9ac8173a503f365b` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.015237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19194e2358a9431c9ac8173a503f365b)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.017210 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.035841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4ffea4c51c493bb40d3de74632f5b6', 'request_id': 'req-2240accc-47c0-41f1-a36e-6978bacb3be9'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.041738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4ffea4c51c493bb40d3de74632f5b6', 'request_id': 'req-2240accc-47c0-41f1-a36e-6978bacb3be9'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.047886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4ffea4c51c493bb40d3de74632f5b6', 'request_id': 'req-2240accc-47c0-41f1-a36e-6978bacb3be9'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.062121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] The token cache is being invalidate because project 8a4ffea4c51c493bb40d3de74632f5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:30.062413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.063030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.064668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 843/1677] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:29 2022] DELETE /identity/v3/projects/8a4ffea4c51c493bb40d3de74632f5b6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:30.066064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19194e2358a9431c9ac8173a503f365b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.068397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.069804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.073503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19194e2358a9431c9ac8173a503f365b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.086604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19194e2358a9431c9ac8173a503f365b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.087303 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19194e2358a9431c9ac8173a503f365b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.087902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6e366025-7f26-4fef-8f99-32b4c2914cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19194e2358a9431c9ac8173a503f365b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.110570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 835/1678] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:29 2022] DELETE /identity/v3/users/19194e2358a9431c9ac8173a503f365b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:30.115319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd50d7-2f8d-414e-ba62-dcdb6fdd47ea None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.115604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd50d7-2f8d-414e-ba62-dcdb6fdd47ea None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.115880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd50d7-2f8d-414e-ba62-dcdb6fdd47ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.135326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-befd50d7-2f8d-414e-ba62-dcdb6fdd47ea None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:30.136561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-befd50d7-2f8d-414e-ba62-dcdb6fdd47ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.142251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240accc-47c0-41f1-a36e-6978bacb3be9 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.196256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 836/1679] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:30.203912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.204675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.204952 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.205221 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] PATH_INFO: `/v3/users/1500f40da9bb4de088905e43979916a2` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.206488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd50d7-2f8d-414e-ba62-dcdb6fdd47ea None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.206602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1500f40da9bb4de088905e43979916a2)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.207839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-befd50d7-2f8d-414e-ba62-dcdb6fdd47ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.208455 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.241543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:30.246959 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:30.258682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1500f40da9bb4de088905e43979916a2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.265667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1500f40da9bb4de088905e43979916a2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.266330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1500f40da9bb4de088905e43979916a2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.273610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd50d7-2f8d-414e-ba62-dcdb6fdd47ea None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.277430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb1590-5ae9-4308-82ff-f64e807d783f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.278201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1590-5ae9-4308-82ff-f64e807d783f service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.278480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1590-5ae9-4308-82ff-f64e807d783f service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.279073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1590-5ae9-4308-82ff-f64e807d783f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.279984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1500f40da9bb4de088905e43979916a2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.280759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1500f40da9bb4de088905e43979916a2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.281324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a6eb1590-5ae9-4308-82ff-f64e807d783f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.293738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb1590-5ae9-4308-82ff-f64e807d783f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.295028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 844/1680] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:30 2022] DELETE /identity/v3/users/1500f40da9bb4de088905e43979916a2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:30.298071 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb1590-5ae9-4308-82ff-f64e807d783f service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.305222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 837/1681] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:30.642272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.645310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.743566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb1590-5ae9-4308-82ff-f64e807d783f service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.745868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a6eb1590-5ae9-4308-82ff-f64e807d783f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.762317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f230a-ec55-423e-adcd-907d16df5693 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.772053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.773432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.774063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.774337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] PATH_INFO: `/v3/projects/89db818bd8534dd98617f2988f466cce` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.775639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89db818bd8534dd98617f2988f466cce)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.778571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.786485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb1590-5ae9-4308-82ff-f64e807d783f service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:30.792486 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:30.793118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.793391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.793769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] PATH_INFO: `/v3/projects/7403aec5888444c58881330c0e33d5d4` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.795654 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7403aec5888444c58881330c0e33d5d4)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:30.798312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:30.854362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7403aec5888444c58881330c0e33d5d4', 'request_id': 'req-6f2054d6-6399-4973-b720-4beb6ebc5002'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.861171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89db818bd8534dd98617f2988f466cce', 'request_id': 'req-3f45fcc3-8330-4f09-b092-bf0f385dc533'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.866554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7403aec5888444c58881330c0e33d5d4', 'request_id': 'req-6f2054d6-6399-4973-b720-4beb6ebc5002'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.873916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7403aec5888444c58881330c0e33d5d4', 'request_id': 'req-6f2054d6-6399-4973-b720-4beb6ebc5002'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.875077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89db818bd8534dd98617f2988f466cce', 'request_id': 'req-3f45fcc3-8330-4f09-b092-bf0f385dc533'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.899757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89db818bd8534dd98617f2988f466cce', 'request_id': 'req-3f45fcc3-8330-4f09-b092-bf0f385dc533'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.900826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] The token cache is being invalidate because project 89db818bd8534dd98617f2988f466cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:30.901417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.901845 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3f45fcc3-8330-4f09-b092-bf0f385dc533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.905030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 845/1682] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:30 2022] DELETE /identity/v3/projects/89db818bd8534dd98617f2988f466cce => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:30.909192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] The token cache is being invalidate because project 7403aec5888444c58881330c0e33d5d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:30.909192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.909192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:30.909954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 838/1683] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:30 2022] DELETE /identity/v3/projects/7403aec5888444c58881330c0e33d5d4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:30.914361 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6993-cda4-49e9-b450-6726fcb97b9f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:30.914760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6993-cda4-49e9-b450-6726fcb97b9f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:30.915225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6993-cda4-49e9-b450-6726fcb97b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:30.920831 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:30.923527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:30.942584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9aee6993-cda4-49e9-b450-6726fcb97b9f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:30.944021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9aee6993-cda4-49e9-b450-6726fcb97b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:31.004410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:31.020609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2054d6-6399-4973-b720-4beb6ebc5002 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.034859 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.035677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.036091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.036560 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] PATH_INFO: `/v3/users/b41e51004f794a58aafd06c68c05c856` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.037915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41e51004f794a58aafd06c68c05c856)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.039985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.046627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 846/1684] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:31.048011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a84253-d440-48f5-ba26-75e6090d4756 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.048327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a84253-d440-48f5-ba26-75e6090d4756 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.048584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a84253-d440-48f5-ba26-75e6090d4756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.083168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-15a84253-d440-48f5-ba26-75e6090d4756 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:31.084757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-15a84253-d440-48f5-ba26-75e6090d4756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:31.096971 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 847/1685] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:31.101157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a84253-d440-48f5-ba26-75e6090d4756 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.115610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a84253-d440-48f5-ba26-75e6090d4756 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.130577 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41e51004f794a58aafd06c68c05c856'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:31.141314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:31.147889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41e51004f794a58aafd06c68c05c856'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:31.168782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeccb2-b231-4c6a-ab37-17c34cc91021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.169722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeccb2-b231-4c6a-ab37-17c34cc91021 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.170065 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeccb2-b231-4c6a-ab37-17c34cc91021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.170552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeccb2-b231-4c6a-ab37-17c34cc91021 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.171423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeccb2-b231-4c6a-ab37-17c34cc91021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:31.171808 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeccb2-b231-4c6a-ab37-17c34cc91021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.173967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeccb2-b231-4c6a-ab37-17c34cc91021 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.178842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41e51004f794a58aafd06c68c05c856'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:31.179631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41e51004f794a58aafd06c68c05c856'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:31.185173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41e51004f794a58aafd06c68c05c856'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:31.204185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 839/1686] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:30 2022] DELETE /identity/v3/users/b41e51004f794a58aafd06c68c05c856 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:31.206564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 848/1687] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:13:31.211381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.212997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:31.321685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f62f5-8e11-49d1-9c41-6a4bca8d5e21 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.328730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8a494-1852-40cd-9b30-99ce70df9a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.329407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8a494-1852-40cd-9b30-99ce70df9a0b admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.329682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8a494-1852-40cd-9b30-99ce70df9a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.329948 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8a494-1852-40cd-9b30-99ce70df9a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.330643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8a494-1852-40cd-9b30-99ce70df9a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.332801 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8a494-1852-40cd-9b30-99ce70df9a0b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.370081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 840/1688] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/projects => generated 399 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:31.374150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeccb2-b231-4c6a-ab37-17c34cc91021 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.386524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeccb2-b231-4c6a-ab37-17c34cc91021 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.472545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f971d9e-5a76-4b90-a81e-4078aaf2759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.473196 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971d9e-5a76-4b90-a81e-4078aaf2759b admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.473478 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971d9e-5a76-4b90-a81e-4078aaf2759b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.473753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971d9e-5a76-4b90-a81e-4078aaf2759b admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.474756 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f971d9e-5a76-4b90-a81e-4078aaf2759b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.476782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f971d9e-5a76-4b90-a81e-4078aaf2759b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.511946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 849/1689] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:31.516534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8a494-1852-40cd-9b30-99ce70df9a0b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.529997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8a494-1852-40cd-9b30-99ce70df9a0b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.546219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08982a-afaf-4ce1-bb71-1fca59669715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.547704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08982a-afaf-4ce1-bb71-1fca59669715 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.548605 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08982a-afaf-4ce1-bb71-1fca59669715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.549584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08982a-afaf-4ce1-bb71-1fca59669715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.550335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08982a-afaf-4ce1-bb71-1fca59669715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.552331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08982a-afaf-4ce1-bb71-1fca59669715 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.569672 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 841/1690] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:31.570141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f971d9e-5a76-4b90-a81e-4078aaf2759b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.582504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f971d9e-5a76-4b90-a81e-4078aaf2759b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.604979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c45110-926e-4aef-b76b-8f02336e90a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.605667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c45110-926e-4aef-b76b-8f02336e90a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.606791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c45110-926e-4aef-b76b-8f02336e90a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.607067 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c45110-926e-4aef-b76b-8f02336e90a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.607718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c45110-926e-4aef-b76b-8f02336e90a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.610078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c45110-926e-4aef-b76b-8f02336e90a5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.618405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08982a-afaf-4ce1-bb71-1fca59669715 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.620350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9a08982a-afaf-4ce1-bb71-1fca59669715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:31.633315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 850/1691] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:31.642054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c45110-926e-4aef-b76b-8f02336e90a5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.648170 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08982a-afaf-4ce1-bb71-1fca59669715 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.657441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.658403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.658693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.659023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] PATH_INFO: `/v3/projects/f0c37b3a50db4fe7beef23b4e46a8952` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.660259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c37b3a50db4fe7beef23b4e46a8952)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.662532 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.668514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c45110-926e-4aef-b76b-8f02336e90a5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.673445 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040a4ba-ea95-4e4d-afe1-51e75d56c48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.674188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040a4ba-ea95-4e4d-afe1-51e75d56c48e admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.674553 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040a4ba-ea95-4e4d-afe1-51e75d56c48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.675042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040a4ba-ea95-4e4d-afe1-51e75d56c48e admin admin] PATH_INFO: `/v3/projects/d8eef080ab97428086e03fc357d4524e/users/0db14edc4bbf4d33acda0995b6fc0acb/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.713691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040a4ba-ea95-4e4d-afe1-51e75d56c48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8eef080ab97428086e03fc357d4524e, user_id=0db14edc4bbf4d33acda0995b6fc0acb, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.718381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040a4ba-ea95-4e4d-afe1-51e75d56c48e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.733986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c37b3a50db4fe7beef23b4e46a8952', 'request_id': 'req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:31.745861 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c37b3a50db4fe7beef23b4e46a8952', 'request_id': 'req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:31.752933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 851/1692] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:31 2022] PUT /identity/v3/projects/d8eef080ab97428086e03fc357d4524e/users/0db14edc4bbf4d33acda0995b6fc0acb/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:31.753746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c37b3a50db4fe7beef23b4e46a8952', 'request_id': 'req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:31.763986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffea3-3aba-4b0b-acc8-c5af554ef10d None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.764273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffea3-3aba-4b0b-acc8-c5af554ef10d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.764612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffea3-3aba-4b0b-acc8-c5af554ef10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.779136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] The token cache is being invalidate because project f0c37b3a50db4fe7beef23b4e46a8952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:31.779431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:31.780092 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c1ca346a-20d2-4a70-9382-f1ef6bd74f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:31.783254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 842/1693] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:31 2022] DELETE /identity/v3/projects/f0c37b3a50db4fe7beef23b4e46a8952 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:31.794478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8679e1-e034-4615-8800-aacf24e543d5 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.795373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8679e1-e034-4615-8800-aacf24e543d5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.795675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8679e1-e034-4615-8800-aacf24e543d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.803489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-310ffea3-3aba-4b0b-acc8-c5af554ef10d None None] MFA Rules not processed for user `0db14edc4bbf4d33acda0995b6fc0acb`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:31.807278 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-310ffea3-3aba-4b0b-acc8-c5af554ef10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:31.833104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4e8679e1-e034-4615-8800-aacf24e543d5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:31.835252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4e8679e1-e034-4615-8800-aacf24e543d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:31.868347 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:31.906763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 852/1694] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:31.911542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ffea3-3aba-4b0b-acc8-c5af554ef10d None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.912356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 843/1695] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:31.913019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-310ffea3-3aba-4b0b-acc8-c5af554ef10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:31.920213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd8cf-8360-4691-8603-56580d48e00b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.920720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd8cf-8360-4691-8603-56580d48e00b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.921117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd8cf-8360-4691-8603-56580d48e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.926767 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ffea3-3aba-4b0b-acc8-c5af554ef10d None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.932959 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bc0d6-32b6-4a3c-806e-c4c9537bbb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.933575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bc0d6-32b6-4a3c-806e-c4c9537bbb53 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.934312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bc0d6-32b6-4a3c-806e-c4c9537bbb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.934312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bc0d6-32b6-4a3c-806e-c4c9537bbb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.934745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bc0d6-32b6-4a3c-806e-c4c9537bbb53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.936857 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bc0d6-32b6-4a3c-806e-c4c9537bbb53 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.942554 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:31.942724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-277fd8cf-8360-4691-8603-56580d48e00b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:31.943932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-277fd8cf-8360-4691-8603-56580d48e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:31.955409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 844/1696] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:31.956530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fd8cf-8360-4691-8603-56580d48e00b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.966455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fd8cf-8360-4691-8603-56580d48e00b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:31.969391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 853/1697] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/projects => generated 401 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:31.973088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bc0d6-32b6-4a3c-806e-c4c9537bbb53 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:31.974319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ba80a-f62c-41b4-b19a-6a5e014008ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:31.975085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ba80a-f62c-41b4-b19a-6a5e014008ab admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:31.975608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ba80a-f62c-41b4-b19a-6a5e014008ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:31.976017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ba80a-f62c-41b4-b19a-6a5e014008ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:31.976881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ba80a-f62c-41b4-b19a-6a5e014008ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:31.977431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ba80a-f62c-41b4-b19a-6a5e014008ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:31.979173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ba80a-f62c-41b4-b19a-6a5e014008ab admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:31.992356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 845/1698] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:13:31.996157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ba80a-f62c-41b4-b19a-6a5e014008ab admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.007458 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ba80a-f62c-41b4-b19a-6a5e014008ab admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.047838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bc0d6-32b6-4a3c-806e-c4c9537bbb53 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.053059 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7143-4cd4-4c5c-8feb-036f4c7f90ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.054087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7143-4cd4-4c5c-8feb-036f4c7f90ba admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.054208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7143-4cd4-4c5c-8feb-036f4c7f90ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.054585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7143-4cd4-4c5c-8feb-036f4c7f90ba admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.055291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a7143-4cd4-4c5c-8feb-036f4c7f90ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.057320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a7143-4cd4-4c5c-8feb-036f4c7f90ba admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.075082 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac9ec8-68e6-4927-bf39-5282f4135cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.075760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9ec8-68e6-4927-bf39-5282f4135cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.076384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9ec8-68e6-4927-bf39-5282f4135cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.077986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9ec8-68e6-4927-bf39-5282f4135cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.079379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac9ec8-68e6-4927-bf39-5282f4135cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.083106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac9ec8-68e6-4927-bf39-5282f4135cc0 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.084406 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 854/1699] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/users => generated 307 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:32.088312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7143-4cd4-4c5c-8feb-036f4c7f90ba admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.098858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7143-4cd4-4c5c-8feb-036f4c7f90ba admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.104243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8dfdf-1b1d-4f76-a9fc-322d06e17ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.105010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8dfdf-1b1d-4f76-a9fc-322d06e17ddc admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.105382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8dfdf-1b1d-4f76-a9fc-322d06e17ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.105705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8dfdf-1b1d-4f76-a9fc-322d06e17ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.106735 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8dfdf-1b1d-4f76-a9fc-322d06e17ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.108574 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8dfdf-1b1d-4f76-a9fc-322d06e17ddc admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.124850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 855/1700] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:32.129489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8dfdf-1b1d-4f76-a9fc-322d06e17ddc admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.136566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 846/1701] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:31 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:32.142390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac9ec8-68e6-4927-bf39-5282f4135cc0 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.143702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8dfdf-1b1d-4f76-a9fc-322d06e17ddc admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.249350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac9ec8-68e6-4927-bf39-5282f4135cc0 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.253403 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801bba3-8da6-46cf-8115-0abb78688816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.254273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801bba3-8da6-46cf-8115-0abb78688816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.254463 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53d60c-959c-4f8f-880e-f436b9b92310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.254852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801bba3-8da6-46cf-8115-0abb78688816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.255268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801bba3-8da6-46cf-8115-0abb78688816 admin admin] PATH_INFO: `/v3/projects/666b81a8bfab408c8108e4456f627cf4/users/eddea5c0bbbf4692965324e92fdea38b/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.255611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53d60c-959c-4f8f-880e-f436b9b92310 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.255985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53d60c-959c-4f8f-880e-f436b9b92310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.256414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53d60c-959c-4f8f-880e-f436b9b92310 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.257204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53d60c-959c-4f8f-880e-f436b9b92310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.260148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53d60c-959c-4f8f-880e-f436b9b92310 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.279283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801bba3-8da6-46cf-8115-0abb78688816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=666b81a8bfab408c8108e4456f627cf4, user_id=eddea5c0bbbf4692965324e92fdea38b, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.282535 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801bba3-8da6-46cf-8115-0abb78688816 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.302175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 856/1702] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:32 2022] PUT /identity/v3/projects/666b81a8bfab408c8108e4456f627cf4/users/eddea5c0bbbf4692965324e92fdea38b/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:32.303639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801bba3-8da6-46cf-8115-0abb78688816 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.304768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 847/1703] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:32 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:32.307696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53d60c-959c-4f8f-880e-f436b9b92310 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.336970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53d60c-959c-4f8f-880e-f436b9b92310 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.377049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:32.382928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:32.407111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801bba3-8da6-46cf-8115-0abb78688816 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.413877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c99442-06ee-4412-8564-9490201a5db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.414890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99442-06ee-4412-8564-9490201a5db8 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.414890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99442-06ee-4412-8564-9490201a5db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.415169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99442-06ee-4412-8564-9490201a5db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.416035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c99442-06ee-4412-8564-9490201a5db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.417726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c99442-06ee-4412-8564-9490201a5db8 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.429774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 857/1704] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:32.434097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c99442-06ee-4412-8564-9490201a5db8 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.444682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c99442-06ee-4412-8564-9490201a5db8 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.449764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f54fb-c500-430b-994e-6f2fab711739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.450551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b807598-56cf-40ca-85fe-747ce7d35854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.450959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807598-56cf-40ca-85fe-747ce7d35854 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.451236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807598-56cf-40ca-85fe-747ce7d35854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.451572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807598-56cf-40ca-85fe-747ce7d35854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.451688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f54fb-c500-430b-994e-6f2fab711739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.451949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f54fb-c500-430b-994e-6f2fab711739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.452157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b807598-56cf-40ca-85fe-747ce7d35854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.452424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f54fb-c500-430b-994e-6f2fab711739 admin admin] PATH_INFO: `/v3/projects/666b81a8bfab408c8108e4456f627cf4/users/eddea5c0bbbf4692965324e92fdea38b/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.454413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b807598-56cf-40ca-85fe-747ce7d35854 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.454588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f54fb-c500-430b-994e-6f2fab711739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=666b81a8bfab408c8108e4456f627cf4, user_id=eddea5c0bbbf4692965324e92fdea38b, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.457501 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f54fb-c500-430b-994e-6f2fab711739 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.467193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 848/1705] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:32.471256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b807598-56cf-40ca-85fe-747ce7d35854 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.474183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 858/1706] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:32 2022] PUT /identity/v3/projects/666b81a8bfab408c8108e4456f627cf4/users/eddea5c0bbbf4692965324e92fdea38b/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:32.484644 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2bea-0e74-45ef-be01-fe83c75be434 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.485030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2bea-0e74-45ef-be01-fe83c75be434 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.485418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2bea-0e74-45ef-be01-fe83c75be434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.487096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b807598-56cf-40ca-85fe-747ce7d35854 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.515970 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-84dd2bea-0e74-45ef-be01-fe83c75be434 None None] MFA Rules not processed for user `eddea5c0bbbf4692965324e92fdea38b`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:32.517270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-84dd2bea-0e74-45ef-be01-fe83c75be434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:32.564326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d46f8-2c74-414e-82f4-7abf64356af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.564326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d46f8-2c74-414e-82f4-7abf64356af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.564326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d46f8-2c74-414e-82f4-7abf64356af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.564326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d46f8-2c74-414e-82f4-7abf64356af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.564771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d46f8-2c74-414e-82f4-7abf64356af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.564771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d46f8-2c74-414e-82f4-7abf64356af2 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.591669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 859/1707] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:32 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:32.602448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2bea-0e74-45ef-be01-fe83c75be434 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.602733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 849/1708] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:32.604207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-84dd2bea-0e74-45ef-be01-fe83c75be434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:32.606760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d46f8-2c74-414e-82f4-7abf64356af2 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.619478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d46f8-2c74-414e-82f4-7abf64356af2 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.624102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba759d0e-9c13-4042-9e56-7a6143b12162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.626019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba759d0e-9c13-4042-9e56-7a6143b12162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.626295 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba759d0e-9c13-4042-9e56-7a6143b12162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.626568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba759d0e-9c13-4042-9e56-7a6143b12162 admin admin] PATH_INFO: `/v3/projects/9c0bfd5a7a47437fb1a5d189941937b1/users/4e76bb82583141558c335361e1f1890b/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.646846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba759d0e-9c13-4042-9e56-7a6143b12162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0bfd5a7a47437fb1a5d189941937b1, user_id=4e76bb82583141558c335361e1f1890b, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.649872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba759d0e-9c13-4042-9e56-7a6143b12162 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.666354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 850/1709] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:32 2022] PUT /identity/v3/projects/9c0bfd5a7a47437fb1a5d189941937b1/users/4e76bb82583141558c335361e1f1890b/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:32.678763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba7296-d0b7-4740-8654-1612968ab6c7 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.679046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba7296-d0b7-4740-8654-1612968ab6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.679318 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba7296-d0b7-4740-8654-1612968ab6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.685337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2bea-0e74-45ef-be01-fe83c75be434 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:32.709264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-34ba7296-d0b7-4740-8654-1612968ab6c7 None None] MFA Rules not processed for user `4e76bb82583141558c335361e1f1890b`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:32.710754 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-34ba7296-d0b7-4740-8654-1612968ab6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:32.750304 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee07691-0b94-45b0-8f88-cdd5bc164cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:32.750942 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee07691-0b94-45b0-8f88-cdd5bc164cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:32.751277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee07691-0b94-45b0-8f88-cdd5bc164cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:32.752406 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee07691-0b94-45b0-8f88-cdd5bc164cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:32.806321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:32.881328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee07691-0b94-45b0-8f88-cdd5bc164cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:32.882904 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee07691-0b94-45b0-8f88-cdd5bc164cc1 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:32.900402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 851/1710] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:32.900739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 860/1711] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:32 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:32.905005 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba7296-d0b7-4740-8654-1612968ab6c7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:32.940196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:33.011258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba7296-d0b7-4740-8654-1612968ab6c7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.027553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f11d-24fe-4aa0-8e34-ef4be6190753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.029568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f11d-24fe-4aa0-8e34-ef4be6190753 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.030144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f11d-24fe-4aa0-8e34-ef4be6190753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.030698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f11d-24fe-4aa0-8e34-ef4be6190753 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.031628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479f11d-24fe-4aa0-8e34-ef4be6190753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.035089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479f11d-24fe-4aa0-8e34-ef4be6190753 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.082626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 852/1712] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:32 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:33.087898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee07691-0b94-45b0-8f88-cdd5bc164cc1 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.119467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee07691-0b94-45b0-8f88-cdd5bc164cc1 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.126140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f11d-24fe-4aa0-8e34-ef4be6190753 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.127874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e479f11d-24fe-4aa0-8e34-ef4be6190753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:33.202891 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29ff05-ed72-4431-b733-008336a3c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.203828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29ff05-ed72-4431-b733-008336a3c079 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.204798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29ff05-ed72-4431-b733-008336a3c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.204798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29ff05-ed72-4431-b733-008336a3c079 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.205506 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29ff05-ed72-4431-b733-008336a3c079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.206150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f11d-24fe-4aa0-8e34-ef4be6190753 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.207925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29ff05-ed72-4431-b733-008336a3c079 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.210890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974b461-5529-4b88-a679-e5107ca1b516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.211681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974b461-5529-4b88-a679-e5107ca1b516 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.212936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974b461-5529-4b88-a679-e5107ca1b516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.213592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974b461-5529-4b88-a679-e5107ca1b516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.242523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 861/1713] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:33 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:33.247336 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29ff05-ed72-4431-b733-008336a3c079 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.273836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29ff05-ed72-4431-b733-008336a3c079 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.304234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46571296-6394-4c86-8331-3e72750105c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.305206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46571296-6394-4c86-8331-3e72750105c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.305554 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46571296-6394-4c86-8331-3e72750105c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.305835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46571296-6394-4c86-8331-3e72750105c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.306517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46571296-6394-4c86-8331-3e72750105c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.308132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46571296-6394-4c86-8331-3e72750105c5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.320021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 862/1714] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:33.330175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974b461-5529-4b88-a679-e5107ca1b516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.331807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974b461-5529-4b88-a679-e5107ca1b516 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.340548 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46571296-6394-4c86-8331-3e72750105c5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.345028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 853/1715] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:33 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:33.351952 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46571296-6394-4c86-8331-3e72750105c5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.367000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b768d6-f64d-4834-84f0-2c0b4e14c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.367686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b768d6-f64d-4834-84f0-2c0b4e14c1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.367966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b768d6-f64d-4834-84f0-2c0b4e14c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.368240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b768d6-f64d-4834-84f0-2c0b4e14c1ca admin admin] PATH_INFO: `/v3/projects/99e872c92a474aaea40978cc05b5408a/users/9f159eafa786441dbf6aee0524201511/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.395623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b768d6-f64d-4834-84f0-2c0b4e14c1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e872c92a474aaea40978cc05b5408a, user_id=9f159eafa786441dbf6aee0524201511, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.400842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b768d6-f64d-4834-84f0-2c0b4e14c1ca admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.431203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 863/1716] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:33 2022] PUT /identity/v3/projects/99e872c92a474aaea40978cc05b5408a/users/9f159eafa786441dbf6aee0524201511/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:33.436412 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974b461-5529-4b88-a679-e5107ca1b516 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.455369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974b461-5529-4b88-a679-e5107ca1b516 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.556521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4c0d-244c-44f9-9db4-72062561557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.557146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4c0d-244c-44f9-9db4-72062561557b admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.557441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4c0d-244c-44f9-9db4-72062561557b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.557794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4c0d-244c-44f9-9db4-72062561557b admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.558438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc4c0d-244c-44f9-9db4-72062561557b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.560227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc4c0d-244c-44f9-9db4-72062561557b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.563803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:33.582684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 854/1717] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:33.587083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b768d6-f64d-4834-84f0-2c0b4e14c1ca admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.606448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b768d6-f64d-4834-84f0-2c0b4e14c1ca admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.617491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b6c1-3184-4a10-af86-dfe30e2fb654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.620142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b6c1-3184-4a10-af86-dfe30e2fb654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.620899 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b6c1-3184-4a10-af86-dfe30e2fb654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.621358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b6c1-3184-4a10-af86-dfe30e2fb654 admin admin] PATH_INFO: `/v3/projects/99e872c92a474aaea40978cc05b5408a/users/9f159eafa786441dbf6aee0524201511/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.624622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94b6c1-3184-4a10-af86-dfe30e2fb654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e872c92a474aaea40978cc05b5408a, user_id=9f159eafa786441dbf6aee0524201511, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.628457 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94b6c1-3184-4a10-af86-dfe30e2fb654 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.644346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 864/1718] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:33 2022] PUT /identity/v3/projects/99e872c92a474aaea40978cc05b5408a/users/9f159eafa786441dbf6aee0524201511/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:33.652706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024f66a-4aad-4d33-9570-fdbc87a14f66 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.653997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024f66a-4aad-4d33-9570-fdbc87a14f66 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.653997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024f66a-4aad-4d33-9570-fdbc87a14f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.688582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2024f66a-4aad-4d33-9570-fdbc87a14f66 None None] MFA Rules not processed for user `9f159eafa786441dbf6aee0524201511`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:33.690091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2024f66a-4aad-4d33-9570-fdbc87a14f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:33.786570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 855/1719] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:33.798538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b6c1-3184-4a10-af86-dfe30e2fb654 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:33.887172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b6c1-3184-4a10-af86-dfe30e2fb654 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:33.891801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72458b31-27f6-4df2-869d-ce43bc7a3282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:33.892378 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458b31-27f6-4df2-869d-ce43bc7a3282 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:33.892663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458b31-27f6-4df2-869d-ce43bc7a3282 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:33.892938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458b31-27f6-4df2-869d-ce43bc7a3282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:33.917388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:33.970297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72458b31-27f6-4df2-869d-ce43bc7a3282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:33.971944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72458b31-27f6-4df2-869d-ce43bc7a3282 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:33.982710 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 865/1720] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:35.571181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024f66a-4aad-4d33-9570-fdbc87a14f66 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:35.573274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2024f66a-4aad-4d33-9570-fdbc87a14f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:35.645925 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024f66a-4aad-4d33-9570-fdbc87a14f66 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:35.651070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:35.651720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:35.651998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:35.652276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] PATH_INFO: `/v3/users/c32fef3e897a49699811e87c12b6c3d3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:35.653465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32fef3e897a49699811e87c12b6c3d3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:35.655452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:35.715110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32fef3e897a49699811e87c12b6c3d3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:35.723568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32fef3e897a49699811e87c12b6c3d3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:35.752273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32fef3e897a49699811e87c12b6c3d3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:35.752935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32fef3e897a49699811e87c12b6c3d3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:35.753628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32fef3e897a49699811e87c12b6c3d3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:35.781331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 856/1721] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:35 2022] DELETE /identity/v3/users/c32fef3e897a49699811e87c12b6c3d3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:35.783068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf503ad-e514-465b-805c-1fa03ccd1309 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:35.784625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf503ad-e514-465b-805c-1fa03ccd1309 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:35.785135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf503ad-e514-465b-805c-1fa03ccd1309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:35.809199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8cf503ad-e514-465b-805c-1fa03ccd1309 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:35.810407 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8cf503ad-e514-465b-805c-1fa03ccd1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:35.870276 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 866/1722] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:35.880192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:35.881693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:35.887078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:35.941303 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b7693-12bd-49a9-9ae3-068395d41bf0 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:35.945265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6f924-2cc1-470a-b4c9-3bb9e4f62618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:35.945792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6f924-2cc1-470a-b4c9-3bb9e4f62618 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:35.946063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6f924-2cc1-470a-b4c9-3bb9e4f62618 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:35.946394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6f924-2cc1-470a-b4c9-3bb9e4f62618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:35.956990 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6f924-2cc1-470a-b4c9-3bb9e4f62618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:35.958424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6f924-2cc1-470a-b4c9-3bb9e4f62618 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:35.968572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 857/1723] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:36.500512 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf503ad-e514-465b-805c-1fa03ccd1309 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:36.502409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8cf503ad-e514-465b-805c-1fa03ccd1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:36.515124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf503ad-e514-465b-805c-1fa03ccd1309 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:36.520169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:36.520974 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:36.521351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:36.521717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] PATH_INFO: `/v3/projects/2b029f76c4534348955998cbcc546af7` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:36.523166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b029f76c4534348955998cbcc546af7)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:36.525268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:36.605099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b029f76c4534348955998cbcc546af7', 'request_id': 'req-89c8d790-383f-4654-a6e1-435ce7d24a74'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:36.612175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b029f76c4534348955998cbcc546af7', 'request_id': 'req-89c8d790-383f-4654-a6e1-435ce7d24a74'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:36.620823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b029f76c4534348955998cbcc546af7', 'request_id': 'req-89c8d790-383f-4654-a6e1-435ce7d24a74'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:36.637047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] The token cache is being invalidate because project 2b029f76c4534348955998cbcc546af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:36.637332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:36.637985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-89c8d790-383f-4654-a6e1-435ce7d24a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:36.639489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 867/1724] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:36 2022] DELETE /identity/v3/projects/2b029f76c4534348955998cbcc546af7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:37.649064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6f924-2cc1-470a-b4c9-3bb9e4f62618 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:37.650663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a9a6f924-2cc1-470a-b4c9-3bb9e4f62618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:37.664000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6f924-2cc1-470a-b4c9-3bb9e4f62618 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:37.757493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:37.757712 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:37.758003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:37.758298 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] PATH_INFO: `/v3/users/0db14edc4bbf4d33acda0995b6fc0acb` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:37.759436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db14edc4bbf4d33acda0995b6fc0acb)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:37.761412 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:37.818567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db14edc4bbf4d33acda0995b6fc0acb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:37.826925 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db14edc4bbf4d33acda0995b6fc0acb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:37.844865 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db14edc4bbf4d33acda0995b6fc0acb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:37.845742 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db14edc4bbf4d33acda0995b6fc0acb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:37.848578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db14edc4bbf4d33acda0995b6fc0acb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:37.867794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 858/1725] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:37 2022] DELETE /identity/v3/users/0db14edc4bbf4d33acda0995b6fc0acb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:37.872461 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad104de-41ea-4892-bd7d-a3fa4b0ca832 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:37.872932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad104de-41ea-4892-bd7d-a3fa4b0ca832 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:37.873009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad104de-41ea-4892-bd7d-a3fa4b0ca832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:37.896122 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-6ad104de-41ea-4892-bd7d-a3fa4b0ca832 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:37.897562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6ad104de-41ea-4892-bd7d-a3fa4b0ca832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:37.944580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:38.000662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 868/1726] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:38.139723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:38.147672 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:38.215956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:38.301077 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eb39a-0161-43c8-ba32-486d144f8b94 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:38.304767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7f691-4f6b-4e0d-91b6-e3395a4b3af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:38.305381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7f691-4f6b-4e0d-91b6-e3395a4b3af4 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:38.305659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7f691-4f6b-4e0d-91b6-e3395a4b3af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:38.305931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7f691-4f6b-4e0d-91b6-e3395a4b3af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:38.316868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7f691-4f6b-4e0d-91b6-e3395a4b3af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:38.318627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7f691-4f6b-4e0d-91b6-e3395a4b3af4 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:38.331471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 859/1727] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:38.377314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad104de-41ea-4892-bd7d-a3fa4b0ca832 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:38.378825 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6ad104de-41ea-4892-bd7d-a3fa4b0ca832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:38.463583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad104de-41ea-4892-bd7d-a3fa4b0ca832 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:38.468092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025b2d7-074f-48d5-b884-9949c299efcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:38.469518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025b2d7-074f-48d5-b884-9949c299efcd service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:38.469845 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025b2d7-074f-48d5-b884-9949c299efcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:38.470121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025b2d7-074f-48d5-b884-9949c299efcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:38.472286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a025b2d7-074f-48d5-b884-9949c299efcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:38.570288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025b2d7-074f-48d5-b884-9949c299efcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:38.572985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025b2d7-074f-48d5-b884-9949c299efcd service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:38.594795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 869/1728] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:38.892892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7f691-4f6b-4e0d-91b6-e3395a4b3af4 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:38.894386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-84c7f691-4f6b-4e0d-91b6-e3395a4b3af4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:38.921445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7f691-4f6b-4e0d-91b6-e3395a4b3af4 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:38.940455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:38.941219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:38.941401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:38.941674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] PATH_INFO: `/v3/projects/d8eef080ab97428086e03fc357d4524e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:38.945072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8eef080ab97428086e03fc357d4524e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:38.948225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:39.081768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8eef080ab97428086e03fc357d4524e', 'request_id': 'req-8ddc3049-de76-4f13-9410-7188995a14a1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.099607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8eef080ab97428086e03fc357d4524e', 'request_id': 'req-8ddc3049-de76-4f13-9410-7188995a14a1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.117783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8eef080ab97428086e03fc357d4524e', 'request_id': 'req-8ddc3049-de76-4f13-9410-7188995a14a1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.151722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] The token cache is being invalidate because project d8eef080ab97428086e03fc357d4524e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:39.153803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.158684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.161917 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 860/1729] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:38 2022] DELETE /identity/v3/projects/d8eef080ab97428086e03fc357d4524e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:39.173199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025b2d7-074f-48d5-b884-9949c299efcd service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:39.186703 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025b2d7-074f-48d5-b884-9949c299efcd service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:39.260464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:39.261037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:39.261316 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:39.261584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] PATH_INFO: `/v3/users/eddea5c0bbbf4692965324e92fdea38b` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:39.262700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eddea5c0bbbf4692965324e92fdea38b)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:39.264630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:39.304740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:39.322309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eddea5c0bbbf4692965324e92fdea38b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.335759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eddea5c0bbbf4692965324e92fdea38b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.336647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eddea5c0bbbf4692965324e92fdea38b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.351089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eddea5c0bbbf4692965324e92fdea38b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.353357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-de8d9750-ae63-4c97-9e7b-ac834cb19c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eddea5c0bbbf4692965324e92fdea38b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.378743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 870/1730] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:39 2022] DELETE /identity/v3/users/eddea5c0bbbf4692965324e92fdea38b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:39.737932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:39.739887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:39.768513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc3049-de76-4f13-9410-7188995a14a1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:39.853493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:39.854363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:39.854716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:39.855134 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] PATH_INFO: `/v3/projects/666b81a8bfab408c8108e4456f627cf4` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:39.856423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=666b81a8bfab408c8108e4456f627cf4)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:39.858480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:39.914491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '666b81a8bfab408c8108e4456f627cf4', 'request_id': 'req-d2c2629e-e22d-48d3-998a-93925d986594'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.918229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:39.925897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '666b81a8bfab408c8108e4456f627cf4', 'request_id': 'req-d2c2629e-e22d-48d3-998a-93925d986594'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.936893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '666b81a8bfab408c8108e4456f627cf4', 'request_id': 'req-d2c2629e-e22d-48d3-998a-93925d986594'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.953504 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] The token cache is being invalidate because project 666b81a8bfab408c8108e4456f627cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:39.954179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.955507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d2c2629e-e22d-48d3-998a-93925d986594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:39.957428 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 861/1731] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:39 2022] DELETE /identity/v3/projects/666b81a8bfab408c8108e4456f627cf4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:39.962487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75837f-355c-4d3a-b84c-57638e95f2ab None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:39.963446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75837f-355c-4d3a-b84c-57638e95f2ab None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:39.963958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75837f-355c-4d3a-b84c-57638e95f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:39.994262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-dd75837f-355c-4d3a-b84c-57638e95f2ab None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:39.995512 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-dd75837f-355c-4d3a-b84c-57638e95f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:40.111565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 871/1732] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:40.124256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07050795-1fc6-435c-b7f6-1ecc31dce9ad None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.124256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07050795-1fc6-435c-b7f6-1ecc31dce9ad None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.124256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07050795-1fc6-435c-b7f6-1ecc31dce9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.158950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-07050795-1fc6-435c-b7f6-1ecc31dce9ad None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:40.160885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-07050795-1fc6-435c-b7f6-1ecc31dce9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:40.174659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 862/1733] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:40.178930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75837f-355c-4d3a-b84c-57638e95f2ab None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:40.196921 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75837f-355c-4d3a-b84c-57638e95f2ab None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:40.202379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b9578-33d6-411d-ae46-9e9325c7ea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:40.203496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b9578-33d6-411d-ae46-9e9325c7ea1e admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.204151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b9578-33d6-411d-ae46-9e9325c7ea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.204675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b9578-33d6-411d-ae46-9e9325c7ea1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.205635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b9578-33d6-411d-ae46-9e9325c7ea1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:40.206133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b9578-33d6-411d-ae46-9e9325c7ea1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:40.210056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b9578-33d6-411d-ae46-9e9325c7ea1e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:40.241041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07050795-1fc6-435c-b7f6-1ecc31dce9ad None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:40.247291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 872/1734] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:40.255697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07050795-1fc6-435c-b7f6-1ecc31dce9ad None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:40.272262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098d0a0-635d-421e-8572-d7f0cf2edbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:40.272944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098d0a0-635d-421e-8572-d7f0cf2edbbf admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.273227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098d0a0-635d-421e-8572-d7f0cf2edbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.273497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098d0a0-635d-421e-8572-d7f0cf2edbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.292406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098d0a0-635d-421e-8572-d7f0cf2edbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:40.292406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098d0a0-635d-421e-8572-d7f0cf2edbbf admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:40.345106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 863/1735] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:40 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:40.349146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b9578-33d6-411d-ae46-9e9325c7ea1e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:40.386650 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b9578-33d6-411d-ae46-9e9325c7ea1e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:40.563426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8193a8a-9343-424d-a9d9-64419adbc207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:40.564105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193a8a-9343-424d-a9d9-64419adbc207 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.564725 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193a8a-9343-424d-a9d9-64419adbc207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.564996 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193a8a-9343-424d-a9d9-64419adbc207 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.565945 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8193a8a-9343-424d-a9d9-64419adbc207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:40.568027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8193a8a-9343-424d-a9d9-64419adbc207 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:40.603298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 873/1736] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:40 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:40.604691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098d0a0-635d-421e-8572-d7f0cf2edbbf admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:40.617900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098d0a0-635d-421e-8572-d7f0cf2edbbf admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:40.641789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ea641-af3d-4b53-973b-7d71bd1e5de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:40.642762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea641-af3d-4b53-973b-7d71bd1e5de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.643157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea641-af3d-4b53-973b-7d71bd1e5de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.643539 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea641-af3d-4b53-973b-7d71bd1e5de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.645148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ea641-af3d-4b53-973b-7d71bd1e5de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:40.647472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ea641-af3d-4b53-973b-7d71bd1e5de2 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:40.658863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 864/1737] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:40.663089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8193a8a-9343-424d-a9d9-64419adbc207 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:40.673743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8193a8a-9343-424d-a9d9-64419adbc207 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:40.679179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5cf51-1c40-458f-88f9-f0fdf4d7ffac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:40.680505 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5cf51-1c40-458f-88f9-f0fdf4d7ffac admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.680787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5cf51-1c40-458f-88f9-f0fdf4d7ffac admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.681057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5cf51-1c40-458f-88f9-f0fdf4d7ffac admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.681884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5cf51-1c40-458f-88f9-f0fdf4d7ffac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:40.683833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5cf51-1c40-458f-88f9-f0fdf4d7ffac admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:40.701799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 874/1738] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:40.703188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ea641-af3d-4b53-973b-7d71bd1e5de2 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:40.717514 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ea641-af3d-4b53-973b-7d71bd1e5de2 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:40.728274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e0257-346d-4a38-81fe-afa045700517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:40.729380 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0257-346d-4a38-81fe-afa045700517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.729884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0257-346d-4a38-81fe-afa045700517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.730379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0257-346d-4a38-81fe-afa045700517 admin admin] PATH_INFO: `/v3/projects/20738ef5e1864d289a160e61cdce459c/users/5763881f4d964f97866387bdfa452f89/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.748534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e0257-346d-4a38-81fe-afa045700517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20738ef5e1864d289a160e61cdce459c, user_id=5763881f4d964f97866387bdfa452f89, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:40.751425 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e0257-346d-4a38-81fe-afa045700517 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:40.767627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 865/1739] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:40 2022] PUT /identity/v3/projects/20738ef5e1864d289a160e61cdce459c/users/5763881f4d964f97866387bdfa452f89/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:40.777922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4bb48-2626-4d3a-be81-ab171b20a151 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.778230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4bb48-2626-4d3a-be81-ab171b20a151 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.778526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4bb48-2626-4d3a-be81-ab171b20a151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.807668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-22d4bb48-2626-4d3a-be81-ab171b20a151 None None] MFA Rules not processed for user `5763881f4d964f97866387bdfa452f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:40.808902 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-22d4bb48-2626-4d3a-be81-ab171b20a151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:40.813147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:40.882033 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b1d2-9c25-4149-9d4e-cb4bb113899e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.882407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b1d2-9c25-4149-9d4e-cb4bb113899e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.882787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b1d2-9c25-4149-9d4e-cb4bb113899e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.884204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 866/1740] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:13:40.894527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fa5fc-84bd-4d8a-9454-0ce1efb765e6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.894812 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fa5fc-84bd-4d8a-9454-0ce1efb765e6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.895086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fa5fc-84bd-4d8a-9454-0ce1efb765e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.895432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 875/1741] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:40.899785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4bb48-2626-4d3a-be81-ab171b20a151 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:40.917198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c06fa5fc-84bd-4d8a-9454-0ce1efb765e6 None None] MFA Rules not processed for user `3a25b60f83d84fb38a759d6620c1c58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:40.918497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c06fa5fc-84bd-4d8a-9454-0ce1efb765e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:40.975876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4bb48-2626-4d3a-be81-ab171b20a151 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:40.981074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3dea3-a630-4262-966c-8651fc23b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:40.981725 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3dea3-a630-4262-966c-8651fc23b071 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:40.981958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3dea3-a630-4262-966c-8651fc23b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:40.982238 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3dea3-a630-4262-966c-8651fc23b071 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:40.982997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3dea3-a630-4262-966c-8651fc23b071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:40.988104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3dea3-a630-4262-966c-8651fc23b071 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:40.998786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 867/1742] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:41.015551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fa5fc-84bd-4d8a-9454-0ce1efb765e6 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.016947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c06fa5fc-84bd-4d8a-9454-0ce1efb765e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.028370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 876/1743] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:40 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:41.029267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3dea3-a630-4262-966c-8651fc23b071 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.032744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-03b3dea3-a630-4262-966c-8651fc23b071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.034236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fa5fc-84bd-4d8a-9454-0ce1efb765e6 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.095119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a45b-c7dd-47c5-b337-2865b45e50ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.095585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3dea3-a630-4262-966c-8651fc23b071 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.095703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a45b-c7dd-47c5-b337-2865b45e50ec service placement] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.095918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a45b-c7dd-47c5-b337-2865b45e50ec service placement] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.096195 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a45b-c7dd-47c5-b337-2865b45e50ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.100202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.100875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.101153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.101480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] PATH_INFO: `/v3/users/8fae2e6c439b4e2894a1fdf72e75a9ae` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.102570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fae2e6c439b4e2894a1fdf72e75a9ae)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.104531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.104768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6a45b-c7dd-47c5-b337-2865b45e50ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.106529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6a45b-c7dd-47c5-b337-2865b45e50ec service placement] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.116982 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 868/1744] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:41.117772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a45b-c7dd-47c5-b337-2865b45e50ec service placement] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.122546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:41.130144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a45b-c7dd-47c5-b337-2865b45e50ec service placement] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.138307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518d19c-42a3-41f4-a023-4f9e3ffec0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.139270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518d19c-42a3-41f4-a023-4f9e3ffec0df admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.139609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518d19c-42a3-41f4-a023-4f9e3ffec0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.139871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518d19c-42a3-41f4-a023-4f9e3ffec0df admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.141126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518d19c-42a3-41f4-a023-4f9e3ffec0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.143133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518d19c-42a3-41f4-a023-4f9e3ffec0df admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.144672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:41.160764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fae2e6c439b4e2894a1fdf72e75a9ae'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.166144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 869/1745] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:41 2022] POST /identity/v3/users => generated 296 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:41.167885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fae2e6c439b4e2894a1fdf72e75a9ae'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.168592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fae2e6c439b4e2894a1fdf72e75a9ae'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.170123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518d19c-42a3-41f4-a023-4f9e3ffec0df admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.171727 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1518d19c-42a3-41f4-a023-4f9e3ffec0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.181581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fae2e6c439b4e2894a1fdf72e75a9ae'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.182230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fae2e6c439b4e2894a1fdf72e75a9ae'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.183520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518d19c-42a3-41f4-a023-4f9e3ffec0df admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.188221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b90cdc-7d01-47cc-9401-75153f4a6ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.188900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b90cdc-7d01-47cc-9401-75153f4a6ade admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.189184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b90cdc-7d01-47cc-9401-75153f4a6ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.189456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b90cdc-7d01-47cc-9401-75153f4a6ade admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.190096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b90cdc-7d01-47cc-9401-75153f4a6ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.191689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b90cdc-7d01-47cc-9401-75153f4a6ade admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.199421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 877/1746] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:41 2022] DELETE /identity/v3/users/8fae2e6c439b4e2894a1fdf72e75a9ae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:41.204324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 870/1747] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:41.205821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.268955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d976b-6f60-4664-8675-cecbbd7c05cb admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.274372 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804efea0-b81c-4f0b-a0b5-f52e193a4cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.275078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804efea0-b81c-4f0b-a0b5-f52e193a4cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.275357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804efea0-b81c-4f0b-a0b5-f52e193a4cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.275629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804efea0-b81c-4f0b-a0b5-f52e193a4cd3 admin admin] PATH_INFO: `/v3/projects/fd65416fabdc4a04a7a46d77ab45cf59/users/0dc5c1451c16422db43a836da1de7067/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.291160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804efea0-b81c-4f0b-a0b5-f52e193a4cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd65416fabdc4a04a7a46d77ab45cf59, user_id=0dc5c1451c16422db43a836da1de7067, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.293877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804efea0-b81c-4f0b-a0b5-f52e193a4cd3 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.307916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 878/1748] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:41 2022] PUT /identity/v3/projects/fd65416fabdc4a04a7a46d77ab45cf59/users/0dc5c1451c16422db43a836da1de7067/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:41.311877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b90cdc-7d01-47cc-9401-75153f4a6ade admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.322166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b90cdc-7d01-47cc-9401-75153f4a6ade admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.372252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804efea0-b81c-4f0b-a0b5-f52e193a4cd3 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.374061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-804efea0-b81c-4f0b-a0b5-f52e193a4cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.383362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a74d7-6f65-471b-923c-0cca83b26147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.384020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a74d7-6f65-471b-923c-0cca83b26147 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.384314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a74d7-6f65-471b-923c-0cca83b26147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.384607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a74d7-6f65-471b-923c-0cca83b26147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.385996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a74d7-6f65-471b-923c-0cca83b26147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.387621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a74d7-6f65-471b-923c-0cca83b26147 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.402183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 871/1749] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:41.403379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a74d7-6f65-471b-923c-0cca83b26147 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.413924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a74d7-6f65-471b-923c-0cca83b26147 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.419056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75629ec-6d57-4870-bb9e-df5098aa4031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.419335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75629ec-6d57-4870-bb9e-df5098aa4031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.419617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75629ec-6d57-4870-bb9e-df5098aa4031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.419893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75629ec-6d57-4870-bb9e-df5098aa4031 admin admin] PATH_INFO: `/v3/projects/fd65416fabdc4a04a7a46d77ab45cf59/users/0dc5c1451c16422db43a836da1de7067/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.421881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75629ec-6d57-4870-bb9e-df5098aa4031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd65416fabdc4a04a7a46d77ab45cf59, user_id=0dc5c1451c16422db43a836da1de7067, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.424573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75629ec-6d57-4870-bb9e-df5098aa4031 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.435930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 872/1750] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:41 2022] PUT /identity/v3/projects/fd65416fabdc4a04a7a46d77ab45cf59/users/0dc5c1451c16422db43a836da1de7067/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:41.447811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907314b6-2fda-41ec-ab41-ad3ad62a1557 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.448130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907314b6-2fda-41ec-ab41-ad3ad62a1557 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.448413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907314b6-2fda-41ec-ab41-ad3ad62a1557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.452191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804efea0-b81c-4f0b-a0b5-f52e193a4cd3 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.476313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-907314b6-2fda-41ec-ab41-ad3ad62a1557 None None] MFA Rules not processed for user `0dc5c1451c16422db43a836da1de7067`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:41.477577 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-907314b6-2fda-41ec-ab41-ad3ad62a1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.490439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:41.510729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.511367 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.511663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.511927 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] PATH_INFO: `/v3/projects/a901a8a6c664467eaedc074300313138` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.513150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a901a8a6c664467eaedc074300313138)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.515156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.553698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 873/1751] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:41.564628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907314b6-2fda-41ec-ab41-ad3ad62a1557 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.566029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-907314b6-2fda-41ec-ab41-ad3ad62a1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.566287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a901a8a6c664467eaedc074300313138', 'request_id': 'req-9e3a673a-c4ec-4d05-855c-c142b4e1852c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.572259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a901a8a6c664467eaedc074300313138', 'request_id': 'req-9e3a673a-c4ec-4d05-855c-c142b4e1852c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.579732 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a901a8a6c664467eaedc074300313138', 'request_id': 'req-9e3a673a-c4ec-4d05-855c-c142b4e1852c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.593347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] The token cache is being invalidate because project a901a8a6c664467eaedc074300313138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:41.593680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.594426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e3a673a-c4ec-4d05-855c-c142b4e1852c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:41.596284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 879/1752] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:41 2022] DELETE /identity/v3/projects/a901a8a6c664467eaedc074300313138 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:41.601717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766beb9-b342-479b-b471-15a4eb499d2e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.602001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766beb9-b342-479b-b471-15a4eb499d2e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.602269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766beb9-b342-479b-b471-15a4eb499d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.619456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:41.623597 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-7766beb9-b342-479b-b471-15a4eb499d2e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:41.625119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7766beb9-b342-479b-b471-15a4eb499d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.632498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907314b6-2fda-41ec-ab41-ad3ad62a1557 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.683499 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ffd9-40ea-45a7-ad5e-610c9b259b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.684188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ffd9-40ea-45a7-ad5e-610c9b259b72 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.684657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ffd9-40ea-45a7-ad5e-610c9b259b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.684993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ffd9-40ea-45a7-ad5e-610c9b259b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.688196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-80b2ffd9-40ea-45a7-ad5e-610c9b259b72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.691819 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 880/1753] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:41.699293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606c78-6273-404a-b9f9-876bd8d1f018 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.700766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606c78-6273-404a-b9f9-876bd8d1f018 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.701290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606c78-6273-404a-b9f9-876bd8d1f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.725620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-86606c78-6273-404a-b9f9-876bd8d1f018 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:41.726918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-86606c78-6273-404a-b9f9-876bd8d1f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:41.737999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 881/1754] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:41.742504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606c78-6273-404a-b9f9-876bd8d1f018 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.752310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606c78-6273-404a-b9f9-876bd8d1f018 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.757306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d410a89-ac43-46b3-908a-6268d301e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.758006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410a89-ac43-46b3-908a-6268d301e792 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.758343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410a89-ac43-46b3-908a-6268d301e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.758778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410a89-ac43-46b3-908a-6268d301e792 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.759428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d410a89-ac43-46b3-908a-6268d301e792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:41.759726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d410a89-ac43-46b3-908a-6268d301e792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.761461 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d410a89-ac43-46b3-908a-6268d301e792 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.765972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2ffd9-40ea-45a7-ad5e-610c9b259b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.768080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2ffd9-40ea-45a7-ad5e-610c9b259b72 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.778941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 882/1755] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:13:41.780386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d410a89-ac43-46b3-908a-6268d301e792 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.782185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 874/1756] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:41.792098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d410a89-ac43-46b3-908a-6268d301e792 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.797264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01939c27-f418-403f-84ce-912dd8c272b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.798004 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939c27-f418-403f-84ce-912dd8c272b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.798459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939c27-f418-403f-84ce-912dd8c272b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.798803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939c27-f418-403f-84ce-912dd8c272b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.799817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01939c27-f418-403f-84ce-912dd8c272b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.802123 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01939c27-f418-403f-84ce-912dd8c272b0 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.840594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 883/1757] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:41 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:41.840706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ffd9-40ea-45a7-ad5e-610c9b259b72 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.861028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ffd9-40ea-45a7-ad5e-610c9b259b72 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.937862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b6a5c-35d8-4123-8c63-068723d929ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.939173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b6a5c-35d8-4123-8c63-068723d929ed admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.939911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b6a5c-35d8-4123-8c63-068723d929ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.940370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b6a5c-35d8-4123-8c63-068723d929ed admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.941189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b6a5c-35d8-4123-8c63-068723d929ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.943135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b6a5c-35d8-4123-8c63-068723d929ed admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:41.969644 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 875/1758] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:41 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:41.970847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01939c27-f418-403f-84ce-912dd8c272b0 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:41.981126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01939c27-f418-403f-84ce-912dd8c272b0 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:41.985914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646828f-368e-4752-a98e-9abd27981394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:41.986528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646828f-368e-4752-a98e-9abd27981394 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:41.987162 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646828f-368e-4752-a98e-9abd27981394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:41.987458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646828f-368e-4752-a98e-9abd27981394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:41.988231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646828f-368e-4752-a98e-9abd27981394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:41.989939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646828f-368e-4752-a98e-9abd27981394 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:42.003835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 884/1759] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:42.005521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b6a5c-35d8-4123-8c63-068723d929ed admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:42.016500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b6a5c-35d8-4123-8c63-068723d929ed admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:42.021181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef197e08-0416-42f8-82a2-6e4759b178de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:42.021793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197e08-0416-42f8-82a2-6e4759b178de admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:42.022070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197e08-0416-42f8-82a2-6e4759b178de admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:42.022345 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197e08-0416-42f8-82a2-6e4759b178de admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:42.023306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef197e08-0416-42f8-82a2-6e4759b178de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:42.025988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef197e08-0416-42f8-82a2-6e4759b178de admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:42.040912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 876/1760] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:42.041101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646828f-368e-4752-a98e-9abd27981394 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:42.057159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646828f-368e-4752-a98e-9abd27981394 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:42.062199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ccf6e-2acd-4cb5-9bac-b835e7dfee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:42.062872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ccf6e-2acd-4cb5-9bac-b835e7dfee7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:42.063155 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ccf6e-2acd-4cb5-9bac-b835e7dfee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:42.063430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ccf6e-2acd-4cb5-9bac-b835e7dfee7a admin admin] PATH_INFO: `/v3/projects/615f56f6b314481fa7f025aefb6a873c/users/51360e31ecb2426aaa32981a54f71fad/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:42.093510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ccf6e-2acd-4cb5-9bac-b835e7dfee7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=615f56f6b314481fa7f025aefb6a873c, user_id=51360e31ecb2426aaa32981a54f71fad, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:42.096462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ccf6e-2acd-4cb5-9bac-b835e7dfee7a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:42.099253 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:42.123227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e55151-7d96-4533-b40b-6fa18812d05f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:42.123670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e55151-7d96-4533-b40b-6fa18812d05f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:42.123953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e55151-7d96-4533-b40b-6fa18812d05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:42.126911 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 885/1761] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:42 2022] PUT /identity/v3/projects/615f56f6b314481fa7f025aefb6a873c/users/51360e31ecb2426aaa32981a54f71fad/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:42.151621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a4e55151-7d96-4533-b40b-6fa18812d05f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:42.152978 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a4e55151-7d96-4533-b40b-6fa18812d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:42.188984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:42.257403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 877/1762] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:42.266856 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ccf6e-2acd-4cb5-9bac-b835e7dfee7a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:42.267317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e55151-7d96-4533-b40b-6fa18812d05f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:42.268666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a4e55151-7d96-4533-b40b-6fa18812d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:42.269109 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2e3ccf6e-2acd-4cb5-9bac-b835e7dfee7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:42.280619 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e55151-7d96-4533-b40b-6fa18812d05f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:42.285259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:42.285886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:42.286160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:42.286421 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] PATH_INFO: `/v3/users/5763881f4d964f97866387bdfa452f89` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:42.287592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5763881f4d964f97866387bdfa452f89)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:42.289592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:42.329880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ccf6e-2acd-4cb5-9bac-b835e7dfee7a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:42.333913 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b68ed-b135-4ae4-ac07-1a11cdb47b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:42.334553 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b68ed-b135-4ae4-ac07-1a11cdb47b1d service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:42.334829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b68ed-b135-4ae4-ac07-1a11cdb47b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:42.335168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b68ed-b135-4ae4-ac07-1a11cdb47b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:42.338801 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5763881f4d964f97866387bdfa452f89'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:42.344516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b68ed-b135-4ae4-ac07-1a11cdb47b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:42.345939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5763881f4d964f97866387bdfa452f89'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:42.346047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b68ed-b135-4ae4-ac07-1a11cdb47b1d service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:42.355205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 886/1763] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:42.357860 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5763881f4d964f97866387bdfa452f89'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:42.358562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5763881f4d964f97866387bdfa452f89'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:42.359282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5763881f4d964f97866387bdfa452f89'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:42.373935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 878/1764] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:42 2022] DELETE /identity/v3/users/5763881f4d964f97866387bdfa452f89 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:42.378307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2bd90-1dc8-44d5-aad8-5681d2e03fb6 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:42.378593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2bd90-1dc8-44d5-aad8-5681d2e03fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:42.378866 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2bd90-1dc8-44d5-aad8-5681d2e03fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:42.399088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-64a2bd90-1dc8-44d5-aad8-5681d2e03fb6 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:42.400394 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-64a2bd90-1dc8-44d5-aad8-5681d2e03fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:42.473799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 887/1765] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:42.483413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:42.484855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:42.547924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261046e-32be-4ce3-9a57-c0dd67db231a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:42.552090 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc96104-599d-4ebd-9d41-0bee4dd507cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:42.552884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc96104-599d-4ebd-9d41-0bee4dd507cb service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:42.553223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc96104-599d-4ebd-9d41-0bee4dd507cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:42.553491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc96104-599d-4ebd-9d41-0bee4dd507cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:42.563443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc96104-599d-4ebd-9d41-0bee4dd507cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:42.564924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc96104-599d-4ebd-9d41-0bee4dd507cb service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:42.574887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 879/1766] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:42.968960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2bd90-1dc8-44d5-aad8-5681d2e03fb6 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:42.970403 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-64a2bd90-1dc8-44d5-aad8-5681d2e03fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:42.984559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2bd90-1dc8-44d5-aad8-5681d2e03fb6 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:42.990496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:42.991778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:42.992119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:42.992610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] PATH_INFO: `/v3/projects/20738ef5e1864d289a160e61cdce459c` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:42.994774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20738ef5e1864d289a160e61cdce459c)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:42.997270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:43.065888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20738ef5e1864d289a160e61cdce459c', 'request_id': 'req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.073029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20738ef5e1864d289a160e61cdce459c', 'request_id': 'req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.082351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20738ef5e1864d289a160e61cdce459c', 'request_id': 'req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.105690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] The token cache is being invalidate because project 20738ef5e1864d289a160e61cdce459c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:43.106072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.108934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.111462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 888/1767] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:42 2022] DELETE /identity/v3/projects/20738ef5e1864d289a160e61cdce459c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:43.116495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc96104-599d-4ebd-9d41-0bee4dd507cb service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:43.126984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc96104-599d-4ebd-9d41-0bee4dd507cb service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:43.193129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:43.236213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:43.237102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:43.237482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:43.237869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] PATH_INFO: `/v3/users/0dc5c1451c16422db43a836da1de7067` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:43.246101 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc5c1451c16422db43a836da1de7067)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:43.248516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:43.301756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc5c1451c16422db43a836da1de7067'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.309682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc5c1451c16422db43a836da1de7067'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.325873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc5c1451c16422db43a836da1de7067'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.326955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc5c1451c16422db43a836da1de7067'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.327888 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc5c1451c16422db43a836da1de7067'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.352021 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 880/1768] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:43 2022] DELETE /identity/v3/users/0dc5c1451c16422db43a836da1de7067 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:43.735644 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:43.737363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:43.758798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df2b45-c099-4c76-b9b5-c70d3a8e7d57 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:43.787901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:43.881233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:43.882277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:43.882792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:43.883257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] PATH_INFO: `/v3/projects/fd65416fabdc4a04a7a46d77ab45cf59` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:43.887606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd65416fabdc4a04a7a46d77ab45cf59)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:43.889823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:43.959632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd65416fabdc4a04a7a46d77ab45cf59', 'request_id': 'req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.967004 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd65416fabdc4a04a7a46d77ab45cf59', 'request_id': 'req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.974612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd65416fabdc4a04a7a46d77ab45cf59', 'request_id': 'req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.993386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] The token cache is being invalidate because project fd65416fabdc4a04a7a46d77ab45cf59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:43.996836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.996836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-00a85760-f2b0-46c2-8d5c-d9ecd614bad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:43.996836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 889/1769] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:43 2022] DELETE /identity/v3/projects/fd65416fabdc4a04a7a46d77ab45cf59 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:43.998575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.000222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.010216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a90117-2d35-4750-8402-ce9368cde77d None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.011797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a90117-2d35-4750-8402-ce9368cde77d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.012177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a90117-2d35-4750-8402-ce9368cde77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.022386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ebd46-e1fc-4491-a325-40fc1e525d4b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.049229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-09a90117-2d35-4750-8402-ce9368cde77d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:44.050798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-09a90117-2d35-4750-8402-ce9368cde77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.127615 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.128598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.128946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.129411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] PATH_INFO: `/v3/users/4e76bb82583141558c335361e1f1890b` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.130886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e76bb82583141558c335361e1f1890b)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.133184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.146219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 890/1770] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:44.155037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce94783-ed03-485e-9d2a-10548ef7cab7 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.155344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce94783-ed03-485e-9d2a-10548ef7cab7 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.155589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce94783-ed03-485e-9d2a-10548ef7cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.190103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-1ce94783-ed03-485e-9d2a-10548ef7cab7 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:44.191830 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1ce94783-ed03-485e-9d2a-10548ef7cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.210053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 891/1771] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:44.211077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce94783-ed03-485e-9d2a-10548ef7cab7 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.239570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e76bb82583141558c335361e1f1890b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:44.239770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce94783-ed03-485e-9d2a-10548ef7cab7 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.255634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7de4e-8820-4c39-acc2-4e0bed7d8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.256624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7de4e-8820-4c39-acc2-4e0bed7d8ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.256949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7de4e-8820-4c39-acc2-4e0bed7d8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.257632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7de4e-8820-4c39-acc2-4e0bed7d8ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.258408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7de4e-8820-4c39-acc2-4e0bed7d8ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:44.259000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7de4e-8820-4c39-acc2-4e0bed7d8ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.261217 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7de4e-8820-4c39-acc2-4e0bed7d8ea4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.262854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e76bb82583141558c335361e1f1890b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:44.269970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:44.276099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 892/1772] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:44.282755 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7de4e-8820-4c39-acc2-4e0bed7d8ea4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.283785 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e76bb82583141558c335361e1f1890b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:44.290162 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e76bb82583141558c335361e1f1890b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:44.294840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-70d7de4e-8820-4c39-acc2-4e0bed7d8ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.298558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0d942e27-6d3d-48bf-ba56-8fe8656a6d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e76bb82583141558c335361e1f1890b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:44.318407 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7de4e-8820-4c39-acc2-4e0bed7d8ea4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.320892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 881/1773] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:43 2022] DELETE /identity/v3/users/4e76bb82583141558c335361e1f1890b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:44.327844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841e894-3c97-4c32-b2b4-71257ee704f4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.328785 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841e894-3c97-4c32-b2b4-71257ee704f4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.329265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841e894-3c97-4c32-b2b4-71257ee704f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.355969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:44.364076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e841e894-3c97-4c32-b2b4-71257ee704f4 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:44.365832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e841e894-3c97-4c32-b2b4-71257ee704f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.422733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380213-2edc-4c4e-8b1f-e71578c4ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.423598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380213-2edc-4c4e-8b1f-e71578c4ca77 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.424021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380213-2edc-4c4e-8b1f-e71578c4ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.424466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380213-2edc-4c4e-8b1f-e71578c4ca77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.425243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a380213-2edc-4c4e-8b1f-e71578c4ca77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.428036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a380213-2edc-4c4e-8b1f-e71578c4ca77 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.451806 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 882/1774] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:44.460706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 893/1775] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:44 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:44.463848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841e894-3c97-4c32-b2b4-71257ee704f4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.464832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380213-2edc-4c4e-8b1f-e71578c4ca77 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.465446 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e841e894-3c97-4c32-b2b4-71257ee704f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.537057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841e894-3c97-4c32-b2b4-71257ee704f4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.541184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380213-2edc-4c4e-8b1f-e71578c4ca77 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.548814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be349e-aa83-42ac-8e61-15e856168fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.549449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be349e-aa83-42ac-8e61-15e856168fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.549737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be349e-aa83-42ac-8e61-15e856168fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.549992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be349e-aa83-42ac-8e61-15e856168fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.551474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be349e-aa83-42ac-8e61-15e856168fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.553852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be349e-aa83-42ac-8e61-15e856168fd4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.582345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 894/1776] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:44 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:44.587244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be349e-aa83-42ac-8e61-15e856168fd4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.597782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40a1a2-3664-48b7-b61d-f95032297778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.598406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a1a2-3664-48b7-b61d-f95032297778 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.598681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a1a2-3664-48b7-b61d-f95032297778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.598950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a1a2-3664-48b7-b61d-f95032297778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.599356 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be349e-aa83-42ac-8e61-15e856168fd4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.605202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca3341-9359-4f22-ad12-00bcadf6ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.605813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca3341-9359-4f22-ad12-00bcadf6ad95 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.606087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca3341-9359-4f22-ad12-00bcadf6ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.606358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca3341-9359-4f22-ad12-00bcadf6ad95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.607002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca3341-9359-4f22-ad12-00bcadf6ad95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.608776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca3341-9359-4f22-ad12-00bcadf6ad95 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.609588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40a1a2-3664-48b7-b61d-f95032297778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.611074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40a1a2-3664-48b7-b61d-f95032297778 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.619783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 895/1777] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:44.621552 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 883/1778] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:44.623459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca3341-9359-4f22-ad12-00bcadf6ad95 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.633405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca3341-9359-4f22-ad12-00bcadf6ad95 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.638786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a6cf6-6a3c-4c27-a779-9794328e12ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.639396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a6cf6-6a3c-4c27-a779-9794328e12ad admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.639711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a6cf6-6a3c-4c27-a779-9794328e12ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.639985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a6cf6-6a3c-4c27-a779-9794328e12ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.640667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a6cf6-6a3c-4c27-a779-9794328e12ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.642369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a6cf6-6a3c-4c27-a779-9794328e12ad admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.654410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 896/1779] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:44.658898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40a1a2-3664-48b7-b61d-f95032297778 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.671018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40a1a2-3664-48b7-b61d-f95032297778 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.678474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6223f7-1838-4f3c-a5ca-8d61f92cbb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.679444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6223f7-1838-4f3c-a5ca-8d61f92cbb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.680106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6223f7-1838-4f3c-a5ca-8d61f92cbb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.680720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6223f7-1838-4f3c-a5ca-8d61f92cbb76 admin admin] PATH_INFO: `/v3/projects/25a50c33c1464ceda166cc814849b395/users/b0da70add62044a5a30895ec7fa69662/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.707467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6223f7-1838-4f3c-a5ca-8d61f92cbb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a50c33c1464ceda166cc814849b395, user_id=b0da70add62044a5a30895ec7fa69662, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.710670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6223f7-1838-4f3c-a5ca-8d61f92cbb76 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:44.732486 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 884/1780] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:44 2022] PUT /identity/v3/projects/25a50c33c1464ceda166cc814849b395/users/b0da70add62044a5a30895ec7fa69662/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:44.743583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234e78-8f39-4a4b-926c-885c5fb8611f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.744076 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234e78-8f39-4a4b-926c-885c5fb8611f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.744170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234e78-8f39-4a4b-926c-885c5fb8611f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.778844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-6d234e78-8f39-4a4b-926c-885c5fb8611f None None] MFA Rules not processed for user `b0da70add62044a5a30895ec7fa69662`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:44.780464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6d234e78-8f39-4a4b-926c-885c5fb8611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.871953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 897/1781] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:44.885000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6223f7-1838-4f3c-a5ca-8d61f92cbb76 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:44.886706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ec6223f7-1838-4f3c-a5ca-8d61f92cbb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:44.913708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:44.976117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6223f7-1838-4f3c-a5ca-8d61f92cbb76 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:44.980688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc134a-d626-4360-b2da-2a91cdba6299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:44.981842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc134a-d626-4360-b2da-2a91cdba6299 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:44.982354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc134a-d626-4360-b2da-2a91cdba6299 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:44.982720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc134a-d626-4360-b2da-2a91cdba6299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:44.996692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc134a-d626-4360-b2da-2a91cdba6299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:44.998390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc134a-d626-4360-b2da-2a91cdba6299 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:45.010822 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 885/1782] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:45.038612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d234e78-8f39-4a4b-926c-885c5fb8611f None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:45.054638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:45.128594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d234e78-8f39-4a4b-926c-885c5fb8611f None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:45.140515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:45.143134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.143450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.143736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] PATH_INFO: `/v3/users/b0da70add62044a5a30895ec7fa69662` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.145008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0da70add62044a5a30895ec7fa69662)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:45.148336 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:45.159802 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc134a-d626-4360-b2da-2a91cdba6299 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:45.161394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3bdc134a-d626-4360-b2da-2a91cdba6299 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:45.178898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc134a-d626-4360-b2da-2a91cdba6299 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:45.185271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:45.185998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.186349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.186694 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] PATH_INFO: `/v3/projects/9c0bfd5a7a47437fb1a5d189941937b1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.187927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0bfd5a7a47437fb1a5d189941937b1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:45.190019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:45.225611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0da70add62044a5a30895ec7fa69662'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.235057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0da70add62044a5a30895ec7fa69662'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.236143 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0da70add62044a5a30895ec7fa69662'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.255171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0da70add62044a5a30895ec7fa69662'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.256140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-14888c1c-46a9-46d8-a50c-9161274bdd2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0da70add62044a5a30895ec7fa69662'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.264233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0bfd5a7a47437fb1a5d189941937b1', 'request_id': 'req-da436a45-081a-415d-b8f4-84981f547fc1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.275737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0bfd5a7a47437fb1a5d189941937b1', 'request_id': 'req-da436a45-081a-415d-b8f4-84981f547fc1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.283348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 898/1783] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:45 2022] DELETE /identity/v3/users/b0da70add62044a5a30895ec7fa69662 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:45.287576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0bfd5a7a47437fb1a5d189941937b1', 'request_id': 'req-da436a45-081a-415d-b8f4-84981f547fc1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.298955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26032db5-f9a7-4e82-b4c6-9474c8c80d5b None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.299841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26032db5-f9a7-4e82-b4c6-9474c8c80d5b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.300471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] The token cache is being invalidate because project 9c0bfd5a7a47437fb1a5d189941937b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:45.300610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26032db5-f9a7-4e82-b4c6-9474c8c80d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.300996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.301777 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.303703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 886/1784] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:45 2022] DELETE /identity/v3/projects/9c0bfd5a7a47437fb1a5d189941937b1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:45.309035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:45.312959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:45.330754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-26032db5-f9a7-4e82-b4c6-9474c8c80d5b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:45.332062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-26032db5-f9a7-4e82-b4c6-9474c8c80d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:45.442748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da436a45-081a-415d-b8f4-84981f547fc1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:45.477826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 899/1785] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:45.493099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26032db5-f9a7-4e82-b4c6-9474c8c80d5b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:45.494494 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-26032db5-f9a7-4e82-b4c6-9474c8c80d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:45.517308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:45.545202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:45.546069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.546491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.546863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] PATH_INFO: `/v3/users/9f159eafa786441dbf6aee0524201511` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.548285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f159eafa786441dbf6aee0524201511)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:45.550360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:45.566420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:45.614427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26032db5-f9a7-4e82-b4c6-9474c8c80d5b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:45.620388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc4cbb-d7f9-455c-b6e5-8530ea536857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:45.620388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc4cbb-d7f9-455c-b6e5-8530ea536857 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:45.620630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc4cbb-d7f9-455c-b6e5-8530ea536857 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:45.621365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc4cbb-d7f9-455c-b6e5-8530ea536857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:45.637985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc4cbb-d7f9-455c-b6e5-8530ea536857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:45.639446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc4cbb-d7f9-455c-b6e5-8530ea536857 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:45.646417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f159eafa786441dbf6aee0524201511'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.654943 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f159eafa786441dbf6aee0524201511'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.664658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 900/1786] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:13:45.671719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f159eafa786441dbf6aee0524201511'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.672949 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f159eafa786441dbf6aee0524201511'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.673729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5de912d1-ea52-439f-b001-2a9da1c6c712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f159eafa786441dbf6aee0524201511'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:45.691970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 887/1787] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:45 2022] DELETE /identity/v3/users/9f159eafa786441dbf6aee0524201511 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:46.184287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc4cbb-d7f9-455c-b6e5-8530ea536857 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.195569 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc4cbb-d7f9-455c-b6e5-8530ea536857 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.274684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.274684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.275664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.275949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] PATH_INFO: `/v3/projects/99e872c92a474aaea40978cc05b5408a` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.277143 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e872c92a474aaea40978cc05b5408a)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.279517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.348131 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e872c92a474aaea40978cc05b5408a', 'request_id': 'req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:46.354612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e872c92a474aaea40978cc05b5408a', 'request_id': 'req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:46.361891 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e872c92a474aaea40978cc05b5408a', 'request_id': 'req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:46.380029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] The token cache is being invalidate because project 99e872c92a474aaea40978cc05b5408a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:46.380174 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:46.381144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d2b64a3d-a88b-4235-9dd8-8b66083fc03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:46.383665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 901/1788] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:46 2022] DELETE /identity/v3/projects/99e872c92a474aaea40978cc05b5408a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:46.389316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33b8e-3610-43e0-bcd1-0e33effa901a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.389877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33b8e-3610-43e0-bcd1-0e33effa901a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.389877 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33b8e-3610-43e0-bcd1-0e33effa901a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.411967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a0d33b8e-3610-43e0-bcd1-0e33effa901a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:46.413452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a0d33b8e-3610-43e0-bcd1-0e33effa901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:46.479291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 888/1789] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:46.495152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c5eb-ada7-437d-a606-9357680cd61e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.495513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c5eb-ada7-437d-a606-9357680cd61e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.496679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c5eb-ada7-437d-a606-9357680cd61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.498314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33b8e-3610-43e0-bcd1-0e33effa901a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.499942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a0d33b8e-3610-43e0-bcd1-0e33effa901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:46.516809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33b8e-3610-43e0-bcd1-0e33effa901a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.524952 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.525737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.526117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.526507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] PATH_INFO: `/v3/projects/25a50c33c1464ceda166cc814849b395` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.528622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a50c33c1464ceda166cc814849b395)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.530867 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.537661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-0f35c5eb-ada7-437d-a606-9357680cd61e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:46.539367 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0f35c5eb-ada7-437d-a606-9357680cd61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:46.549307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 902/1790] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:46.553408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c5eb-ada7-437d-a606-9357680cd61e None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.563877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c5eb-ada7-437d-a606-9357680cd61e None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.571035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96873824-9cb5-4a87-8d30-349ce37fb709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.572393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873824-9cb5-4a87-8d30-349ce37fb709 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.572944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873824-9cb5-4a87-8d30-349ce37fb709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.573288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873824-9cb5-4a87-8d30-349ce37fb709 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.574430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96873824-9cb5-4a87-8d30-349ce37fb709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:46.574829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96873824-9cb5-4a87-8d30-349ce37fb709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.580934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96873824-9cb5-4a87-8d30-349ce37fb709 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.599909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 903/1791] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:13:46.601144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96873824-9cb5-4a87-8d30-349ce37fb709 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.615827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96873824-9cb5-4a87-8d30-349ce37fb709 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.639633 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a50c33c1464ceda166cc814849b395', 'request_id': 'req-e78a1dc1-eba6-4615-825d-ed78b5e359f4'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:46.651329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a50c33c1464ceda166cc814849b395', 'request_id': 'req-e78a1dc1-eba6-4615-825d-ed78b5e359f4'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:46.659573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a50c33c1464ceda166cc814849b395', 'request_id': 'req-e78a1dc1-eba6-4615-825d-ed78b5e359f4'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:46.662646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:46.677218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] The token cache is being invalidate because project 25a50c33c1464ceda166cc814849b395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:46.677935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:46.678785 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:46.681582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 889/1792] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:46 2022] DELETE /identity/v3/projects/25a50c33c1464ceda166cc814849b395 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:46.700858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:46.724522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbdba6-3667-40ab-bf24-c0e4fa69f9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.726072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbdba6-3667-40ab-bf24-c0e4fa69f9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.726544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbdba6-3667-40ab-bf24-c0e4fa69f9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.727047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbdba6-3667-40ab-bf24-c0e4fa69f9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.728256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbdba6-3667-40ab-bf24-c0e4fa69f9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.730605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbdba6-3667-40ab-bf24-c0e4fa69f9c2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.778597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.780916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:46.790936 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 904/1793] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:46 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:46.809107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a1dc1-eba6-4615-825d-ed78b5e359f4 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.903851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0d831-d796-47b0-b37c-f005e893531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.905054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0d831-d796-47b0-b37c-f005e893531b admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.905437 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0d831-d796-47b0-b37c-f005e893531b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.905803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0d831-d796-47b0-b37c-f005e893531b admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.906622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0d831-d796-47b0-b37c-f005e893531b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.908923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0d831-d796-47b0-b37c-f005e893531b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.942910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 890/1794] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:46 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:46.946823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbdba6-3667-40ab-bf24-c0e4fa69f9c2 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:46.959132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbdba6-3667-40ab-bf24-c0e4fa69f9c2 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:46.969870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41b7b9-71d4-43d6-8542-890a12b2d6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:46.970608 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41b7b9-71d4-43d6-8542-890a12b2d6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:46.971124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41b7b9-71d4-43d6-8542-890a12b2d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:46.971598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41b7b9-71d4-43d6-8542-890a12b2d6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:46.972516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41b7b9-71d4-43d6-8542-890a12b2d6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:46.975009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41b7b9-71d4-43d6-8542-890a12b2d6fa admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:46.995789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 905/1795] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:46.999397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0d831-d796-47b0-b37c-f005e893531b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.011429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0d831-d796-47b0-b37c-f005e893531b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.017713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a95ace-8a3b-4d05-971f-f0a41eb67849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.018620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a95ace-8a3b-4d05-971f-f0a41eb67849 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.019045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a95ace-8a3b-4d05-971f-f0a41eb67849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.020256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a95ace-8a3b-4d05-971f-f0a41eb67849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.022686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a95ace-8a3b-4d05-971f-f0a41eb67849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.025152 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a95ace-8a3b-4d05-971f-f0a41eb67849 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.038729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 891/1796] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:13:47.058097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41b7b9-71d4-43d6-8542-890a12b2d6fa admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.072258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41b7b9-71d4-43d6-8542-890a12b2d6fa admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.081773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3486cd-7842-40b5-a00b-4ee7fc20d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.082462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3486cd-7842-40b5-a00b-4ee7fc20d631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.082738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3486cd-7842-40b5-a00b-4ee7fc20d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.083008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3486cd-7842-40b5-a00b-4ee7fc20d631 admin admin] PATH_INFO: `/v3/projects/3c5d2d39f3744653ac212cd483b69e87/users/e55f176151c742bb9422c1ce3d6e8d92/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.102654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3486cd-7842-40b5-a00b-4ee7fc20d631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5d2d39f3744653ac212cd483b69e87, user_id=e55f176151c742bb9422c1ce3d6e8d92, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.106762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3486cd-7842-40b5-a00b-4ee7fc20d631 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.137154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 906/1797] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:47 2022] PUT /identity/v3/projects/3c5d2d39f3744653ac212cd483b69e87/users/e55f176151c742bb9422c1ce3d6e8d92/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:47.139950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b6af1-8ecb-48fd-876d-e87259bab7ca None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.140464 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b6af1-8ecb-48fd-876d-e87259bab7ca None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.140738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b6af1-8ecb-48fd-876d-e87259bab7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.172867 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f13b6af1-8ecb-48fd-876d-e87259bab7ca None None] MFA Rules not processed for user `e55f176151c742bb9422c1ce3d6e8d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:47.174109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f13b6af1-8ecb-48fd-876d-e87259bab7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:47.276333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 892/1798] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:47.279833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3486cd-7842-40b5-a00b-4ee7fc20d631 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.393738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3486cd-7842-40b5-a00b-4ee7fc20d631 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.401623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea979c35-f6ec-4069-8cda-ccce5875fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.402453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979c35-f6ec-4069-8cda-ccce5875fbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.402801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979c35-f6ec-4069-8cda-ccce5875fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.403420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979c35-f6ec-4069-8cda-ccce5875fbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.403842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea979c35-f6ec-4069-8cda-ccce5875fbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.406110 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea979c35-f6ec-4069-8cda-ccce5875fbf8 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.447661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 907/1799] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:47 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:47.451401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b6af1-8ecb-48fd-876d-e87259bab7ca None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.475970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b6af1-8ecb-48fd-876d-e87259bab7ca None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.597632 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590086-ad7c-4153-a572-c0926255ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.598313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590086-ad7c-4153-a572-c0926255ce5b admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.598596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590086-ad7c-4153-a572-c0926255ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.598865 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590086-ad7c-4153-a572-c0926255ce5b admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.599516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590086-ad7c-4153-a572-c0926255ce5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.602942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590086-ad7c-4153-a572-c0926255ce5b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.612196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:47.640472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 893/1800] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:47 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:47.643880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea979c35-f6ec-4069-8cda-ccce5875fbf8 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.655462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea979c35-f6ec-4069-8cda-ccce5875fbf8 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.663542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00899a2-852f-4c24-accc-faca3d4d4d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.664350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00899a2-852f-4c24-accc-faca3d4d4d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.664700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00899a2-852f-4c24-accc-faca3d4d4d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.665080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00899a2-852f-4c24-accc-faca3d4d4d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.665945 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00899a2-852f-4c24-accc-faca3d4d4d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.669559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00899a2-852f-4c24-accc-faca3d4d4d4a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.707243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 908/1801] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:47.709631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590086-ad7c-4153-a572-c0926255ce5b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.724148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590086-ad7c-4153-a572-c0926255ce5b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.728872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4720f-8e64-416a-b67e-8a46ec95a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.729581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4720f-8e64-416a-b67e-8a46ec95a966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.729858 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4720f-8e64-416a-b67e-8a46ec95a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.730129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4720f-8e64-416a-b67e-8a46ec95a966 admin admin] PATH_INFO: `/v3/projects/8679ff0fe6eb4c4a9b9331c7890eaf6a/users/f2cdb8b2b3b348108c93c22f1d069718/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.766713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4720f-8e64-416a-b67e-8a46ec95a966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8679ff0fe6eb4c4a9b9331c7890eaf6a, user_id=f2cdb8b2b3b348108c93c22f1d069718, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.771048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4720f-8e64-416a-b67e-8a46ec95a966 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.799595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 894/1802] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:47 2022] PUT /identity/v3/projects/8679ff0fe6eb4c4a9b9331c7890eaf6a/users/f2cdb8b2b3b348108c93c22f1d069718/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:47.803595 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00899a2-852f-4c24-accc-faca3d4d4d4a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.814014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00899a2-852f-4c24-accc-faca3d4d4d4a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.888016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b8849-5bed-4d7d-969e-4289480db0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.888676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8849-5bed-4d7d-969e-4289480db0fb admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.888999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8849-5bed-4d7d-969e-4289480db0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.889274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8849-5bed-4d7d-969e-4289480db0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.890526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b8849-5bed-4d7d-969e-4289480db0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.892267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b8849-5bed-4d7d-969e-4289480db0fb admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.905471 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 909/1803] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:47.909431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4720f-8e64-416a-b67e-8a46ec95a966 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:47.933673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4720f-8e64-416a-b67e-8a46ec95a966 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:47.943032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dd5c1-9ace-4b0e-8619-1c41c29d0543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:47.944009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dd5c1-9ace-4b0e-8619-1c41c29d0543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.944565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dd5c1-9ace-4b0e-8619-1c41c29d0543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.945048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dd5c1-9ace-4b0e-8619-1c41c29d0543 admin admin] PATH_INFO: `/v3/projects/8679ff0fe6eb4c4a9b9331c7890eaf6a/users/f2cdb8b2b3b348108c93c22f1d069718/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:47.948378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dd5c1-9ace-4b0e-8619-1c41c29d0543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8679ff0fe6eb4c4a9b9331c7890eaf6a, user_id=f2cdb8b2b3b348108c93c22f1d069718, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:47.951328 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dd5c1-9ace-4b0e-8619-1c41c29d0543 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:47.969751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 895/1804] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:47 2022] PUT /identity/v3/projects/8679ff0fe6eb4c4a9b9331c7890eaf6a/users/f2cdb8b2b3b348108c93c22f1d069718/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:47.979879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097e707-2c5e-4eb3-aab7-a4b935dd7b7a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:47.980207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097e707-2c5e-4eb3-aab7-a4b935dd7b7a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:47.980464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097e707-2c5e-4eb3-aab7-a4b935dd7b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:48.008495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:48.026831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-7097e707-2c5e-4eb3-aab7-a4b935dd7b7a None None] MFA Rules not processed for user `f2cdb8b2b3b348108c93c22f1d069718`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:48.028144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7097e707-2c5e-4eb3-aab7-a4b935dd7b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.142211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 910/1805] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:48.161243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dd5c1-9ace-4b0e-8619-1c41c29d0543 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:48.163538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-374dd5c1-9ace-4b0e-8619-1c41c29d0543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.266861 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dd5c1-9ace-4b0e-8619-1c41c29d0543 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:48.271665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ecbb5-68ba-4666-85c2-6ee0cdfb5c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:48.272334 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ecbb5-68ba-4666-85c2-6ee0cdfb5c4c service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:48.272676 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ecbb5-68ba-4666-85c2-6ee0cdfb5c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:48.272952 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ecbb5-68ba-4666-85c2-6ee0cdfb5c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:48.343591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ecbb5-68ba-4666-85c2-6ee0cdfb5c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:48.345355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ecbb5-68ba-4666-85c2-6ee0cdfb5c4c service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:48.372807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 896/1806] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:48.445564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168ccf-6d6d-4351-89c8-3ddca5b1c65f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:48.446114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168ccf-6d6d-4351-89c8-3ddca5b1c65f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:48.446114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168ccf-6d6d-4351-89c8-3ddca5b1c65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:48.488553 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c3168ccf-6d6d-4351-89c8-3ddca5b1c65f None None] MFA Rules not processed for user `e422b50b0ead4b9e837ac893300b0be0`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:48.490891 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c3168ccf-6d6d-4351-89c8-3ddca5b1c65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.497944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a8af0-2660-4d05-b850-8eaa280dac70 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:48.498453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a8af0-2660-4d05-b850-8eaa280dac70 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:48.498537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a8af0-2660-4d05-b850-8eaa280dac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:48.577244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f74a8af0-2660-4d05-b850-8eaa280dac70 None None] MFA Rules not processed for user `51360e31ecb2426aaa32981a54f71fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:48.579038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f74a8af0-2660-4d05-b850-8eaa280dac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.608850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 911/1807] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:48.752589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:48.780389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 897/1808] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:48.857837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168ccf-6d6d-4351-89c8-3ddca5b1c65f None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:48.859619 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c3168ccf-6d6d-4351-89c8-3ddca5b1c65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:48.943300 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168ccf-6d6d-4351-89c8-3ddca5b1c65f None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:48.948863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e3cf8-ba6b-4f3d-baf0-b9f796abf9a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:48.949559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3cf8-ba6b-4f3d-baf0-b9f796abf9a9 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:48.949802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3cf8-ba6b-4f3d-baf0-b9f796abf9a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:48.950052 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3cf8-ba6b-4f3d-baf0-b9f796abf9a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:48.959451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e3cf8-ba6b-4f3d-baf0-b9f796abf9a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:48.961265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e3cf8-ba6b-4f3d-baf0-b9f796abf9a9 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:48.972829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 912/1809] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:50.479161 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b08ab1-64f7-4c95-a54c-396f1930300d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:50.480592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b08ab1-64f7-4c95-a54c-396f1930300d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:50.481245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b08ab1-64f7-4c95-a54c-396f1930300d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:50.521687 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-44b08ab1-64f7-4c95-a54c-396f1930300d None None] MFA Rules not processed for user `51360e31ecb2426aaa32981a54f71fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:50.523190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-44b08ab1-64f7-4c95-a54c-396f1930300d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:50.538547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 898/1810] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:51.260393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e3cf8-ba6b-4f3d-baf0-b9f796abf9a9 service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:51.304790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:51.352463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e3cf8-ba6b-4f3d-baf0-b9f796abf9a9 service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:51.361619 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:51.362383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:51.362734 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:51.363078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] PATH_INFO: `/v3/users/e55f176151c742bb9422c1ce3d6e8d92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.375038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55f176151c742bb9422c1ce3d6e8d92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:51.377095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:51.434293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55f176151c742bb9422c1ce3d6e8d92'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:51.446819 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55f176151c742bb9422c1ce3d6e8d92'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:51.447897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55f176151c742bb9422c1ce3d6e8d92'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:51.463706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55f176151c742bb9422c1ce3d6e8d92'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:51.464550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55f176151c742bb9422c1ce3d6e8d92'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:51.480807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 913/1811] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:51 2022] DELETE /identity/v3/users/e55f176151c742bb9422c1ce3d6e8d92 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:51.485275 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830674cf-64e9-4ab0-bb83-1ed6d1bb3bac None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:51.485735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830674cf-64e9-4ab0-bb83-1ed6d1bb3bac None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:51.485993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830674cf-64e9-4ab0-bb83-1ed6d1bb3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.513375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-830674cf-64e9-4ab0-bb83-1ed6d1bb3bac None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:51.515456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-830674cf-64e9-4ab0-bb83-1ed6d1bb3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:51.625793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 899/1812] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:51.635958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:51.637470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:51.723064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124325-be2d-4495-b7cd-8b8e6966942b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:51.727034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e403223-a034-4654-95bd-b49d13dca201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:51.728048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e403223-a034-4654-95bd-b49d13dca201 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:51.728380 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e403223-a034-4654-95bd-b49d13dca201 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:51.729195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e403223-a034-4654-95bd-b49d13dca201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:51.746720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e403223-a034-4654-95bd-b49d13dca201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:51.760153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e403223-a034-4654-95bd-b49d13dca201 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:51.795840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 914/1813] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:52.188889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830674cf-64e9-4ab0-bb83-1ed6d1bb3bac None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:52.190431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-830674cf-64e9-4ab0-bb83-1ed6d1bb3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:52.214572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830674cf-64e9-4ab0-bb83-1ed6d1bb3bac None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:52.238649 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:52.239642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:52.240041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:52.240606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] PATH_INFO: `/v3/projects/3c5d2d39f3744653ac212cd483b69e87` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:52.247270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5d2d39f3744653ac212cd483b69e87)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:52.249675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:52.328629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5d2d39f3744653ac212cd483b69e87', 'request_id': 'req-583044ea-e805-4428-866b-d9522f0b290d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:52.344765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5d2d39f3744653ac212cd483b69e87', 'request_id': 'req-583044ea-e805-4428-866b-d9522f0b290d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:52.358245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5d2d39f3744653ac212cd483b69e87', 'request_id': 'req-583044ea-e805-4428-866b-d9522f0b290d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:52.372743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] The token cache is being invalidate because project 3c5d2d39f3744653ac212cd483b69e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:52.373452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:52.374666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:52.376984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 900/1814] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:52 2022] DELETE /identity/v3/projects/3c5d2d39f3744653ac212cd483b69e87 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:52.382122 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e403223-a034-4654-95bd-b49d13dca201 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:52.395118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e403223-a034-4654-95bd-b49d13dca201 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:52.481568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:52.504977 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:52.505867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:52.506201 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:52.506615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] PATH_INFO: `/v3/users/f2cdb8b2b3b348108c93c22f1d069718` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:52.511161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2cdb8b2b3b348108c93c22f1d069718)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:52.517306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:52.622692 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2cdb8b2b3b348108c93c22f1d069718'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:52.633928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2cdb8b2b3b348108c93c22f1d069718'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:52.634742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2cdb8b2b3b348108c93c22f1d069718'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:52.657416 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2cdb8b2b3b348108c93c22f1d069718'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:52.658166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-25b97c21-122f-4b7c-8907-e9f50c7f4fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2cdb8b2b3b348108c93c22f1d069718'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:52.697993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 915/1815] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:52 2022] DELETE /identity/v3/users/f2cdb8b2b3b348108c93c22f1d069718 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:53.051479 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:53.053071 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:53.066599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583044ea-e805-4428-866b-d9522f0b290d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:53.122604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:53.123237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.123513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.123783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] PATH_INFO: `/v3/projects/8679ff0fe6eb4c4a9b9331c7890eaf6a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.125067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8679ff0fe6eb4c4a9b9331c7890eaf6a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:53.127013 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:53.143110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:53.175857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8679ff0fe6eb4c4a9b9331c7890eaf6a', 'request_id': 'req-d6166f11-8350-43e2-bdfe-fbffd83efdf0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:53.185085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8679ff0fe6eb4c4a9b9331c7890eaf6a', 'request_id': 'req-d6166f11-8350-43e2-bdfe-fbffd83efdf0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:53.192430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8679ff0fe6eb4c4a9b9331c7890eaf6a', 'request_id': 'req-d6166f11-8350-43e2-bdfe-fbffd83efdf0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:53.204127 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] The token cache is being invalidate because project 8679ff0fe6eb4c4a9b9331c7890eaf6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:53.204579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:53.205264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d6166f11-8350-43e2-bdfe-fbffd83efdf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:53.206911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 901/1816] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:53 2022] DELETE /identity/v3/projects/8679ff0fe6eb4c4a9b9331c7890eaf6a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:53.211916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8cadc-acbf-4517-a373-18babda76f62 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.212205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8cadc-acbf-4517-a373-18babda76f62 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.212524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8cadc-acbf-4517-a373-18babda76f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.238386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d0f8cadc-acbf-4517-a373-18babda76f62 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:53.240508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d0f8cadc-acbf-4517-a373-18babda76f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:53.319343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 916/1817] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:53.328677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08e41c-33d8-450f-a0fe-116ef0f41414 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.328965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08e41c-33d8-450f-a0fe-116ef0f41414 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.329254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08e41c-33d8-450f-a0fe-116ef0f41414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.352977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ef08e41c-33d8-450f-a0fe-116ef0f41414 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:53.355711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ef08e41c-33d8-450f-a0fe-116ef0f41414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:53.367630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 902/1818] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:53.368842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8cadc-acbf-4517-a373-18babda76f62 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:53.381687 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8cadc-acbf-4517-a373-18babda76f62 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:53.387097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e677-780f-4d4b-86d2-7e7b7b3d1ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:53.387749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e677-780f-4d4b-86d2-7e7b7b3d1ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.388008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e677-780f-4d4b-86d2-7e7b7b3d1ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.388535 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e677-780f-4d4b-86d2-7e7b7b3d1ea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.389268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06e677-780f-4d4b-86d2-7e7b7b3d1ea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:53.389769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06e677-780f-4d4b-86d2-7e7b7b3d1ea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:53.391896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06e677-780f-4d4b-86d2-7e7b7b3d1ea7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:53.408332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 917/1819] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:53.410835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08e41c-33d8-450f-a0fe-116ef0f41414 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:53.421260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08e41c-33d8-450f-a0fe-116ef0f41414 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:53.426732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb187ee-e6c2-4c72-80f4-622785c71dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:53.427351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb187ee-e6c2-4c72-80f4-622785c71dab admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.427957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb187ee-e6c2-4c72-80f4-622785c71dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.427957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb187ee-e6c2-4c72-80f4-622785c71dab admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.428689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb187ee-e6c2-4c72-80f4-622785c71dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:53.430968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb187ee-e6c2-4c72-80f4-622785c71dab admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:53.459657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 903/1820] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:53 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:53.464359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e677-780f-4d4b-86d2-7e7b7b3d1ea7 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:53.475515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e677-780f-4d4b-86d2-7e7b7b3d1ea7 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:53.529442 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:53.541800 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654bdc-0a0c-4446-9ae2-5ab57dfc360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:53.542423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654bdc-0a0c-4446-9ae2-5ab57dfc360d admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.542688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654bdc-0a0c-4446-9ae2-5ab57dfc360d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.542971 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654bdc-0a0c-4446-9ae2-5ab57dfc360d admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.543627 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9654bdc-0a0c-4446-9ae2-5ab57dfc360d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:53.545575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9654bdc-0a0c-4446-9ae2-5ab57dfc360d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:53.568372 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 918/1821] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:53 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:53.572762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb187ee-e6c2-4c72-80f4-622785c71dab admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:53.585561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb187ee-e6c2-4c72-80f4-622785c71dab admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:53.590408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37df1f9-e521-4a48-850b-bfc8c8c87178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:53.591020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37df1f9-e521-4a48-850b-bfc8c8c87178 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.591300 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37df1f9-e521-4a48-850b-bfc8c8c87178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.591572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37df1f9-e521-4a48-850b-bfc8c8c87178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.592227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37df1f9-e521-4a48-850b-bfc8c8c87178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:53.593892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37df1f9-e521-4a48-850b-bfc8c8c87178 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:53.604800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 904/1822] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:53.609130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654bdc-0a0c-4446-9ae2-5ab57dfc360d admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:53.619624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654bdc-0a0c-4446-9ae2-5ab57dfc360d admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:53.624215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b7232-96b7-4a81-8fb1-5b8f995fffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:53.624855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b7232-96b7-4a81-8fb1-5b8f995fffa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.625253 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b7232-96b7-4a81-8fb1-5b8f995fffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.625528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b7232-96b7-4a81-8fb1-5b8f995fffa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.626180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b7232-96b7-4a81-8fb1-5b8f995fffa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:53.627784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b7232-96b7-4a81-8fb1-5b8f995fffa2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:53.638973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 919/1823] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:53.643132 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37df1f9-e521-4a48-850b-bfc8c8c87178 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:53.654863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37df1f9-e521-4a48-850b-bfc8c8c87178 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:53.660994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c46f4-d731-4237-bdc1-6408a1acc03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:53.661771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c46f4-d731-4237-bdc1-6408a1acc03c admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.662184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c46f4-d731-4237-bdc1-6408a1acc03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.662547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c46f4-d731-4237-bdc1-6408a1acc03c admin admin] PATH_INFO: `/v3/projects/cf81e9c79c01446f9e316c5d27b1b652/users/6751a44236bd4fdfaa130b433f1ec83b/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.678411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c46f4-d731-4237-bdc1-6408a1acc03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf81e9c79c01446f9e316c5d27b1b652, user_id=6751a44236bd4fdfaa130b433f1ec83b, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:53.681426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c46f4-d731-4237-bdc1-6408a1acc03c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:53.695632 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 905/1824] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:53 2022] PUT /identity/v3/projects/cf81e9c79c01446f9e316c5d27b1b652/users/6751a44236bd4fdfaa130b433f1ec83b/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:13:53.706203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b9db4-0aef-4c4a-960d-215aa805385e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.706731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b9db4-0aef-4c4a-960d-215aa805385e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.707127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b9db4-0aef-4c4a-960d-215aa805385e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.742155 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-972b9db4-0aef-4c4a-960d-215aa805385e None None] MFA Rules not processed for user `6751a44236bd4fdfaa130b433f1ec83b`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:53.743653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-972b9db4-0aef-4c4a-960d-215aa805385e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:53.818415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 920/1825] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:53.829883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c46f4-d731-4237-bdc1-6408a1acc03c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:53.832848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-475c46f4-d731-4237-bdc1-6408a1acc03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:53.918065 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c46f4-d731-4237-bdc1-6408a1acc03c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:53.921662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9324be5-ed36-48f9-a515-1e8081aab479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:53.922279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9324be5-ed36-48f9-a515-1e8081aab479 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:53.922553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9324be5-ed36-48f9-a515-1e8081aab479 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:53.922827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9324be5-ed36-48f9-a515-1e8081aab479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:53.931716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9324be5-ed36-48f9-a515-1e8081aab479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:53.933183 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9324be5-ed36-48f9-a515-1e8081aab479 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:53.942038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 906/1826] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:57.054422 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b9db4-0aef-4c4a-960d-215aa805385e None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:57.120016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b9db4-0aef-4c4a-960d-215aa805385e None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:57.129001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:57.129838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.130187 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.130520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] PATH_INFO: `/v3/users/6751a44236bd4fdfaa130b433f1ec83b` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.131857 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6751a44236bd4fdfaa130b433f1ec83b)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:57.133839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:57.186640 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6751a44236bd4fdfaa130b433f1ec83b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.196276 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6751a44236bd4fdfaa130b433f1ec83b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.197154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6751a44236bd4fdfaa130b433f1ec83b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.202208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:57.211949 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6751a44236bd4fdfaa130b433f1ec83b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.213751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6751a44236bd4fdfaa130b433f1ec83b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.228477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 921/1827] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:13:57 2022] DELETE /identity/v3/users/6751a44236bd4fdfaa130b433f1ec83b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:57.233476 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18047c7-4266-4e87-bf7d-4fe76e7f5d7b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.233951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18047c7-4266-4e87-bf7d-4fe76e7f5d7b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.234029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18047c7-4266-4e87-bf7d-4fe76e7f5d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.263839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f18047c7-4266-4e87-bf7d-4fe76e7f5d7b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:57.265413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f18047c7-4266-4e87-bf7d-4fe76e7f5d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.310363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:57.340452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 907/1828] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:13:57.353854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:57.355843 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.422315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef9c5c-e985-416c-b67a-9f32d9cd35f6 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:57.426612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d2675-228f-4c6f-8204-f0a0d90f323d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:57.427308 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d2675-228f-4c6f-8204-f0a0d90f323d service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.427755 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d2675-228f-4c6f-8204-f0a0d90f323d service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.428126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d2675-228f-4c6f-8204-f0a0d90f323d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.448535 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d2675-228f-4c6f-8204-f0a0d90f323d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:57.450083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d2675-228f-4c6f-8204-f0a0d90f323d service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:57.461441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 922/1829] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:13:57.744377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18047c7-4266-4e87-bf7d-4fe76e7f5d7b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:57.746028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f18047c7-4266-4e87-bf7d-4fe76e7f5d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.760006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18047c7-4266-4e87-bf7d-4fe76e7f5d7b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:57.765237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:57.766120 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.766454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.766792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] PATH_INFO: `/v3/projects/cf81e9c79c01446f9e316c5d27b1b652` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.768763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf81e9c79c01446f9e316c5d27b1b652)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:57.770808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:57.820680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf81e9c79c01446f9e316c5d27b1b652', 'request_id': 'req-d03c9a04-7dcd-484f-ae40-deaa9cf73607'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.828928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf81e9c79c01446f9e316c5d27b1b652', 'request_id': 'req-d03c9a04-7dcd-484f-ae40-deaa9cf73607'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.835626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf81e9c79c01446f9e316c5d27b1b652', 'request_id': 'req-d03c9a04-7dcd-484f-ae40-deaa9cf73607'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.853259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] The token cache is being invalidate because project cf81e9c79c01446f9e316c5d27b1b652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:13:57.853550 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.854204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d03c9a04-7dcd-484f-ae40-deaa9cf73607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:13:57.855840 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 908/1830] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:13:57 2022] DELETE /identity/v3/projects/cf81e9c79c01446f9e316c5d27b1b652 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:57.860935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587ff3-37ba-4b15-85ac-802c79acf830 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.861220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587ff3-37ba-4b15-85ac-802c79acf830 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.861825 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587ff3-37ba-4b15-85ac-802c79acf830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.881586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-79587ff3-37ba-4b15-85ac-802c79acf830 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:57.882870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-79587ff3-37ba-4b15-85ac-802c79acf830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.945886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 923/1831] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:57.954310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f6d0-42e0-4c35-bd72-c591d6d7631b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:57.954592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f6d0-42e0-4c35-bd72-c591d6d7631b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:57.955014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f6d0-42e0-4c35-bd72-c591d6d7631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:57.976691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ea27f6d0-42e0-4c35-bd72-c591d6d7631b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:57.978035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ea27f6d0-42e0-4c35-bd72-c591d6d7631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:57.986721 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 909/1832] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:57.991252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587ff3-37ba-4b15-85ac-802c79acf830 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.001113 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587ff3-37ba-4b15-85ac-802c79acf830 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.006578 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e23fc-375c-48f9-a90b-084c1b6e5ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.007195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e23fc-375c-48f9-a90b-084c1b6e5ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.007797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e23fc-375c-48f9-a90b-084c1b6e5ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.007797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e23fc-375c-48f9-a90b-084c1b6e5ca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.008460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e23fc-375c-48f9-a90b-084c1b6e5ca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:13:58.008762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e23fc-375c-48f9-a90b-084c1b6e5ca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.010365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e23fc-375c-48f9-a90b-084c1b6e5ca8 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.027626 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 924/1833] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:13:58.032048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27f6d0-42e0-4c35-bd72-c591d6d7631b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.041808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27f6d0-42e0-4c35-bd72-c591d6d7631b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.046725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773ec79-95d2-4de7-bf07-d74674a320c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.047340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ec79-95d2-4de7-bf07-d74674a320c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.047621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ec79-95d2-4de7-bf07-d74674a320c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.047894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ec79-95d2-4de7-bf07-d74674a320c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.052497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773ec79-95d2-4de7-bf07-d74674a320c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.054448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773ec79-95d2-4de7-bf07-d74674a320c3 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.084149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 910/1834] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:13:58 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:13:58.088135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e23fc-375c-48f9-a90b-084c1b6e5ca8 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.098093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e23fc-375c-48f9-a90b-084c1b6e5ca8 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.154549 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01860ce6-22b2-4aa7-a1c5-044d63a95071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.155222 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01860ce6-22b2-4aa7-a1c5-044d63a95071 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.155502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01860ce6-22b2-4aa7-a1c5-044d63a95071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.155771 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01860ce6-22b2-4aa7-a1c5-044d63a95071 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.156479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01860ce6-22b2-4aa7-a1c5-044d63a95071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.158386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01860ce6-22b2-4aa7-a1c5-044d63a95071 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.174151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:58.185199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 925/1835] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:13:58 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:13:58.186486 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773ec79-95d2-4de7-bf07-d74674a320c3 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.196961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773ec79-95d2-4de7-bf07-d74674a320c3 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.202284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7762574-8f5d-4ff2-871f-3ead27f93fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.202985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7762574-8f5d-4ff2-871f-3ead27f93fce admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.203181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7762574-8f5d-4ff2-871f-3ead27f93fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.203481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7762574-8f5d-4ff2-871f-3ead27f93fce admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.204116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7762574-8f5d-4ff2-871f-3ead27f93fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.205832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7762574-8f5d-4ff2-871f-3ead27f93fce admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.216027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 911/1836] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:58.220256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01860ce6-22b2-4aa7-a1c5-044d63a95071 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.231870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01860ce6-22b2-4aa7-a1c5-044d63a95071 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.237248 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af02f6-5b1a-48cf-967d-191447c0ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.237853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af02f6-5b1a-48cf-967d-191447c0ca62 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.238136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af02f6-5b1a-48cf-967d-191447c0ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.238406 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af02f6-5b1a-48cf-967d-191447c0ca62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.239047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af02f6-5b1a-48cf-967d-191447c0ca62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.240772 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af02f6-5b1a-48cf-967d-191447c0ca62 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.251678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 926/1837] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:13:58.257071 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7762574-8f5d-4ff2-871f-3ead27f93fce admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.266173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7762574-8f5d-4ff2-871f-3ead27f93fce admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.271502 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de76a3f-7f7f-42ab-b28c-8e30a1f14c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.272237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de76a3f-7f7f-42ab-b28c-8e30a1f14c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.272553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de76a3f-7f7f-42ab-b28c-8e30a1f14c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.272825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de76a3f-7f7f-42ab-b28c-8e30a1f14c7e admin admin] PATH_INFO: `/v3/projects/68433da6aede445da2bffe0ffeadad4d/users/48e1f7de41ec46858998c1cb8cb0475e/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.287814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de76a3f-7f7f-42ab-b28c-8e30a1f14c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68433da6aede445da2bffe0ffeadad4d, user_id=48e1f7de41ec46858998c1cb8cb0475e, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.290559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de76a3f-7f7f-42ab-b28c-8e30a1f14c7e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.304573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 912/1838] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:13:58 2022] PUT /identity/v3/projects/68433da6aede445da2bffe0ffeadad4d/users/48e1f7de41ec46858998c1cb8cb0475e/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:13:58.314782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b404bea-c7cd-44e2-8a62-fb2d7fd18cd4 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.315075 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b404bea-c7cd-44e2-8a62-fb2d7fd18cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.315347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b404bea-c7cd-44e2-8a62-fb2d7fd18cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.343635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-3b404bea-c7cd-44e2-8a62-fb2d7fd18cd4 None None] MFA Rules not processed for user `48e1f7de41ec46858998c1cb8cb0475e`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:13:58.345048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3b404bea-c7cd-44e2-8a62-fb2d7fd18cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:58.410679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 927/1839] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:13:58.422480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de76a3f-7f7f-42ab-b28c-8e30a1f14c7e admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:13:58.424156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0de76a3f-7f7f-42ab-b28c-8e30a1f14c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:13:58.494602 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:58.505179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de76a3f-7f7f-42ab-b28c-8e30a1f14c7e admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:13:58.510200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc61e0-49ca-480b-9fd8-b9576f43f1ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47768a5f86d4c6292099691f6cab1e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:13:58.510813 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc61e0-49ca-480b-9fd8-b9576f43f1ef service glance] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:13:58.511091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc61e0-49ca-480b-9fd8-b9576f43f1ef service glance] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:13:58.511364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc61e0-49ca-480b-9fd8-b9576f43f1ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:13:58.520161 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc61e0-49ca-480b-9fd8-b9576f43f1ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:13:58.521673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc61e0-49ca-480b-9fd8-b9576f43f1ef service glance] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:13:58.531068 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 913/1840] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:13:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:08.408614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=38 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:08.526498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=7 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:10.121356 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9968b52-5b21-4d45-901b-b7b0e6ccb080 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.121900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9968b52-5b21-4d45-901b-b7b0e6ccb080 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.121900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9968b52-5b21-4d45-901b-b7b0e6ccb080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.142978 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d9968b52-5b21-4d45-901b-b7b0e6ccb080 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:10.144094 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d9968b52-5b21-4d45-901b-b7b0e6ccb080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.200908 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 928/1841] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:14:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:10.246792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc61e0-49ca-480b-9fd8-b9576f43f1ef service glance] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:10.248250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2ffc61e0-49ca-480b-9fd8-b9576f43f1ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:10.325314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc61e0-49ca-480b-9fd8-b9576f43f1ef service glance] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:10.330559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4623f-7f47-489f-a15d-a7843940bf57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:10.331403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4623f-7f47-489f-a15d-a7843940bf57 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:10.331688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4623f-7f47-489f-a15d-a7843940bf57 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:10.331977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4623f-7f47-489f-a15d-a7843940bf57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:10.341229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4623f-7f47-489f-a15d-a7843940bf57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:10.342842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4623f-7f47-489f-a15d-a7843940bf57 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:10.351089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 914/1842] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:14:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:14:17.981428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c00ad-481d-4139-86da-c54edd2e1472 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:17.981955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c00ad-481d-4139-86da-c54edd2e1472 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:17.982437 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c00ad-481d-4139-86da-c54edd2e1472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:18.005185 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-806c00ad-481d-4139-86da-c54edd2e1472 None None] MFA Rules not processed for user `8d4c78fc725b440eb266b0365cbfcedd`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:18.006557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-806c00ad-481d-4139-86da-c54edd2e1472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:18.081671 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 929/1843] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:20.347989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=32 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:26.482634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4623f-7f47-489f-a15d-a7843940bf57 service swift] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.556223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4623f-7f47-489f-a15d-a7843940bf57 service swift] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.561262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.562019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.562514 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.563380 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] PATH_INFO: `/v3/users/48e1f7de41ec46858998c1cb8cb0475e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.564119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e1f7de41ec46858998c1cb8cb0475e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.566182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.661790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e1f7de41ec46858998c1cb8cb0475e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.672761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e1f7de41ec46858998c1cb8cb0475e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.691004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e1f7de41ec46858998c1cb8cb0475e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.691888 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e1f7de41ec46858998c1cb8cb0475e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.692641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e1f7de41ec46858998c1cb8cb0475e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:26.709333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 915/1844] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:26 2022] DELETE /identity/v3/users/48e1f7de41ec46858998c1cb8cb0475e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:26.714105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578517e-1149-4e4b-b1c7-17fa08803a0c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.714615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578517e-1149-4e4b-b1c7-17fa08803a0c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.714615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578517e-1149-4e4b-b1c7-17fa08803a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.736919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-3578517e-1149-4e4b-b1c7-17fa08803a0c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:26.738137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3578517e-1149-4e4b-b1c7-17fa08803a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:26.813830 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 930/1845] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:14:26.823969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:26.825524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:26.900039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44518e2-c2d9-4353-be3a-b900973a5a49 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:26.904323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa06a3-62b2-4cd9-a956-c93c62d0372f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:26.904956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa06a3-62b2-4cd9-a956-c93c62d0372f service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:26.905247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa06a3-62b2-4cd9-a956-c93c62d0372f service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:26.905479 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa06a3-62b2-4cd9-a956-c93c62d0372f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:26.917053 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa06a3-62b2-4cd9-a956-c93c62d0372f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:26.918752 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa06a3-62b2-4cd9-a956-c93c62d0372f service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:26.931366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 916/1846] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:27.255421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578517e-1149-4e4b-b1c7-17fa08803a0c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.257996 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3578517e-1149-4e4b-b1c7-17fa08803a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.272572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578517e-1149-4e4b-b1c7-17fa08803a0c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.279104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.279799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.280079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.280381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] PATH_INFO: `/v3/projects/68433da6aede445da2bffe0ffeadad4d` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.281570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68433da6aede445da2bffe0ffeadad4d)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.283774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.342122 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:27.345920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68433da6aede445da2bffe0ffeadad4d', 'request_id': 'req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:27.353976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68433da6aede445da2bffe0ffeadad4d', 'request_id': 'req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:27.361497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68433da6aede445da2bffe0ffeadad4d', 'request_id': 'req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:27.381885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] The token cache is being invalidate because project 68433da6aede445da2bffe0ffeadad4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:27.382192 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:27.383558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a21cdb9d-dbe7-4e79-9a7c-8732b00e8b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:27.384836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 931/1847] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:27 2022] DELETE /identity/v3/projects/68433da6aede445da2bffe0ffeadad4d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:27.391296 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4c1c-8dc2-4420-8770-f10956a643cc None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.391580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4c1c-8dc2-4420-8770-f10956a643cc None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.391855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4c1c-8dc2-4420-8770-f10956a643cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.415858 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-78cd4c1c-8dc2-4420-8770-f10956a643cc None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:27.417132 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-78cd4c1c-8dc2-4420-8770-f10956a643cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.441411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:27.521069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 917/1848] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:27.528332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d936c-3c95-4a81-a2fa-5ee8dcc442ab None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.528636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d936c-3c95-4a81-a2fa-5ee8dcc442ab None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.528890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d936c-3c95-4a81-a2fa-5ee8dcc442ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.553345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-763d936c-3c95-4a81-a2fa-5ee8dcc442ab None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:27.554576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-763d936c-3c95-4a81-a2fa-5ee8dcc442ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:27.575827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 932/1849] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:27.595477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd4c1c-8dc2-4420-8770-f10956a643cc None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.607201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd4c1c-8dc2-4420-8770-f10956a643cc None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.612236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca62f-8bb3-4a45-9e1a-63d1b9fbd38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.613023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca62f-8bb3-4a45-9e1a-63d1b9fbd38d admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.613297 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca62f-8bb3-4a45-9e1a-63d1b9fbd38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.613564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca62f-8bb3-4a45-9e1a-63d1b9fbd38d admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.614381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ca62f-8bb3-4a45-9e1a-63d1b9fbd38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:27.614683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ca62f-8bb3-4a45-9e1a-63d1b9fbd38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.616762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ca62f-8bb3-4a45-9e1a-63d1b9fbd38d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.631872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 918/1850] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:14:27.636411 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d936c-3c95-4a81-a2fa-5ee8dcc442ab None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.650022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d936c-3c95-4a81-a2fa-5ee8dcc442ab None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.654736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c220a-0c97-4280-97bd-e4e510271684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.655343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c220a-0c97-4280-97bd-e4e510271684 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.655609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c220a-0c97-4280-97bd-e4e510271684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.655883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c220a-0c97-4280-97bd-e4e510271684 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.656571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c220a-0c97-4280-97bd-e4e510271684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.658629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c220a-0c97-4280-97bd-e4e510271684 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.706323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 933/1851] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:27 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:27.710312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca62f-8bb3-4a45-9e1a-63d1b9fbd38d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.721355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca62f-8bb3-4a45-9e1a-63d1b9fbd38d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.795122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd0772-e170-453a-8476-6248f7e32474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.796118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd0772-e170-453a-8476-6248f7e32474 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.796630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd0772-e170-453a-8476-6248f7e32474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.797102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd0772-e170-453a-8476-6248f7e32474 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.797942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd0772-e170-453a-8476-6248f7e32474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.800313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd0772-e170-453a-8476-6248f7e32474 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.837178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 919/1852] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:27 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:14:27.838661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c220a-0c97-4280-97bd-e4e510271684 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.860803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c220a-0c97-4280-97bd-e4e510271684 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.872928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669ede2-bde1-4bb8-ac13-57c44a5f1ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.880032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669ede2-bde1-4bb8-ac13-57c44a5f1ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.880966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669ede2-bde1-4bb8-ac13-57c44a5f1ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.881423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669ede2-bde1-4bb8-ac13-57c44a5f1ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.882559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669ede2-bde1-4bb8-ac13-57c44a5f1ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.887151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669ede2-bde1-4bb8-ac13-57c44a5f1ee9 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.915043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 934/1853] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:27.917202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd0772-e170-453a-8476-6248f7e32474 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.934512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd0772-e170-453a-8476-6248f7e32474 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:27.943202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63f102-884c-40b1-bf48-1a45f0d7e117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:27.943899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63f102-884c-40b1-bf48-1a45f0d7e117 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:27.944180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63f102-884c-40b1-bf48-1a45f0d7e117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:27.944473 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63f102-884c-40b1-bf48-1a45f0d7e117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:27.945182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63f102-884c-40b1-bf48-1a45f0d7e117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:27.947125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63f102-884c-40b1-bf48-1a45f0d7e117 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:27.978003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 920/1854] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:27.982508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669ede2-bde1-4bb8-ac13-57c44a5f1ee9 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:27.998197 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669ede2-bde1-4bb8-ac13-57c44a5f1ee9 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:28.014152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3309e-c2a2-4908-892e-40ca3253c97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:28.015108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3309e-c2a2-4908-892e-40ca3253c97a admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.015518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3309e-c2a2-4908-892e-40ca3253c97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.015966 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3309e-c2a2-4908-892e-40ca3253c97a admin admin] PATH_INFO: `/v3/projects/bcb7515378f043c6a48afc421af03fe8/users/6dd31d16274c47989b7daf5ae60c04f1/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.052969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3309e-c2a2-4908-892e-40ca3253c97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb7515378f043c6a48afc421af03fe8, user_id=6dd31d16274c47989b7daf5ae60c04f1, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:28.055847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3309e-c2a2-4908-892e-40ca3253c97a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:28.100320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 935/1855] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:27 2022] PUT /identity/v3/projects/bcb7515378f043c6a48afc421af03fe8/users/6dd31d16274c47989b7daf5ae60c04f1/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:28.181608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f01ab-e4da-4e4f-849d-4e2c7dc4b0ad None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.181939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f01ab-e4da-4e4f-849d-4e2c7dc4b0ad None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.182218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f01ab-e4da-4e4f-849d-4e2c7dc4b0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.242776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ae6f01ab-e4da-4e4f-849d-4e2c7dc4b0ad None None] MFA Rules not processed for user `6dd31d16274c47989b7daf5ae60c04f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:28.244100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ae6f01ab-e4da-4e4f-849d-4e2c7dc4b0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:28.373000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 921/1856] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:28.390419 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3309e-c2a2-4908-892e-40ca3253c97a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:28.392128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-eac3309e-c2a2-4908-892e-40ca3253c97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:28.465036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3309e-c2a2-4908-892e-40ca3253c97a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:28.469355 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ffded-e6c7-401b-bb99-d28ff0896142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:28.469990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ffded-e6c7-401b-bb99-d28ff0896142 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:28.470269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ffded-e6c7-401b-bb99-d28ff0896142 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:28.470534 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ffded-e6c7-401b-bb99-d28ff0896142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:28.480671 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ffded-e6c7-401b-bb99-d28ff0896142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:28.482137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ffded-e6c7-401b-bb99-d28ff0896142 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:28.495426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 936/1857] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:30.913588 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b0ac5-37cb-445b-bd97-db65b5aae163 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:30.914106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b0ac5-37cb-445b-bd97-db65b5aae163 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:30.914271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b0ac5-37cb-445b-bd97-db65b5aae163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:30.933811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f16b0ac5-37cb-445b-bd97-db65b5aae163 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:30.935047 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f16b0ac5-37cb-445b-bd97-db65b5aae163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:30.947871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:30.995890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 922/1858] 10.222.0.15 () {58 vars in 967 bytes} [Mon Oct 24 13:14:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:31.011058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ffded-e6c7-401b-bb99-d28ff0896142 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:31.012551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-643ffded-e6c7-401b-bb99-d28ff0896142 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:31.084246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ffded-e6c7-401b-bb99-d28ff0896142 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:31.089625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825a7e4-e9f4-4ba0-a2f6-92ae4c57c242 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:31.090231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a7e4-e9f4-4ba0-a2f6-92ae4c57c242 service swift] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:31.090506 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a7e4-e9f4-4ba0-a2f6-92ae4c57c242 service swift] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:31.090828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a7e4-e9f4-4ba0-a2f6-92ae4c57c242 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:31.099273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825a7e4-e9f4-4ba0-a2f6-92ae4c57c242 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:31.100875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825a7e4-e9f4-4ba0-a2f6-92ae4c57c242 service swift] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:31.109160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 937/1859] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:14:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:14:33.150400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf26ca-238f-4b9f-a24d-3a54d9cd0294 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:33.150400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf26ca-238f-4b9f-a24d-3a54d9cd0294 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:33.150400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf26ca-238f-4b9f-a24d-3a54d9cd0294 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:33.150400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 923/1860] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:14:33.161780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526d63c-40cb-4dcb-860a-ede56bc05e6f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:33.162898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526d63c-40cb-4dcb-860a-ede56bc05e6f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:33.162898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526d63c-40cb-4dcb-860a-ede56bc05e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:33.170523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:33.185922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5526d63c-40cb-4dcb-860a-ede56bc05e6f None None] MFA Rules not processed for user `3a25b60f83d84fb38a759d6620c1c58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:33.188063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5526d63c-40cb-4dcb-860a-ede56bc05e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:33.225396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf26ca-238f-4b9f-a24d-3a54d9cd0294 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:33.227431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e9bf26ca-238f-4b9f-a24d-3a54d9cd0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:33.284422 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 938/1861] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:14:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:33.297804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334c2ef-9916-4980-9332-a0c2f058246e None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:33.298177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334c2ef-9916-4980-9332-a0c2f058246e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:33.298566 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334c2ef-9916-4980-9332-a0c2f058246e None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:33.300767 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 939/1862] 10.222.0.15 () {54 vars in 961 bytes} [Mon Oct 24 13:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 13:14:33.305557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854147ef-0b0e-4fe4-9909-b61eedb1d6ba None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:33.306202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854147ef-0b0e-4fe4-9909-b61eedb1d6ba None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:33.306202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854147ef-0b0e-4fe4-9909-b61eedb1d6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:33.338864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-854147ef-0b0e-4fe4-9909-b61eedb1d6ba None None] MFA Rules not processed for user `3a25b60f83d84fb38a759d6620c1c58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:33.340476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-854147ef-0b0e-4fe4-9909-b61eedb1d6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:33.341330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf26ca-238f-4b9f-a24d-3a54d9cd0294 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:33.347458 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:33.348197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:33.348547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:33.348806 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] PATH_INFO: `/v3/users/e422b50b0ead4b9e837ac893300b0be0` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:33.350000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e422b50b0ead4b9e837ac893300b0be0)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:33.353326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:33.357036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 940/1863] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Oct 24 13:14:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:33.375150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854147ef-0b0e-4fe4-9909-b61eedb1d6ba None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:33.393674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854147ef-0b0e-4fe4-9909-b61eedb1d6ba None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:33.403121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461b1ca-88e2-4d39-b761-920794fdbdb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:33.404498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461b1ca-88e2-4d39-b761-920794fdbdb3 service placement] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:33.404848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461b1ca-88e2-4d39-b761-920794fdbdb3 service placement] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:33.405181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461b1ca-88e2-4d39-b761-920794fdbdb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:33.416243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461b1ca-88e2-4d39-b761-920794fdbdb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:33.417995 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461b1ca-88e2-4d39-b761-920794fdbdb3 service placement] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:33.430661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 941/1864] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:14:33.443166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e422b50b0ead4b9e837ac893300b0be0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:33.452256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e422b50b0ead4b9e837ac893300b0be0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:33.469383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e422b50b0ead4b9e837ac893300b0be0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:33.470230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e422b50b0ead4b9e837ac893300b0be0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:33.470853 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8d00c131-6e80-4c30-89cd-851d71c7dd08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e422b50b0ead4b9e837ac893300b0be0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:33.492206 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 924/1865] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:33 2022] DELETE /identity/v3/users/e422b50b0ead4b9e837ac893300b0be0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:33.729353 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461b1ca-88e2-4d39-b761-920794fdbdb3 service placement] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:33.750180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461b1ca-88e2-4d39-b761-920794fdbdb3 service placement] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:33.878302 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:33.882003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:33.882299 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:33.882595 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] PATH_INFO: `/v3/projects/31ca7a7fcfd74033bd8228adf26ea0eb` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:33.896319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ca7a7fcfd74033bd8228adf26ea0eb)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:33.896319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:33.994262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ca7a7fcfd74033bd8228adf26ea0eb', 'request_id': 'req-228b529b-34e3-428e-9c2d-63dc4c22ae1c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:34.001079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ca7a7fcfd74033bd8228adf26ea0eb', 'request_id': 'req-228b529b-34e3-428e-9c2d-63dc4c22ae1c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:34.009762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ca7a7fcfd74033bd8228adf26ea0eb', 'request_id': 'req-228b529b-34e3-428e-9c2d-63dc4c22ae1c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:34.026709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] The token cache is being invalidate because project 31ca7a7fcfd74033bd8228adf26ea0eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:34.026916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:34.027562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-228b529b-34e3-428e-9c2d-63dc4c22ae1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:34.029436 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 942/1866] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:33 2022] DELETE /identity/v3/projects/31ca7a7fcfd74033bd8228adf26ea0eb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:34.040399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38daa2-749a-45f2-881d-033a2d8c09e3 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.041773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38daa2-749a-45f2-881d-033a2d8c09e3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.042295 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38daa2-749a-45f2-881d-033a2d8c09e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.071689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9a38daa2-749a-45f2-881d-033a2d8c09e3 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:34.073320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9a38daa2-749a-45f2-881d-033a2d8c09e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:34.139180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:34.167410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 925/1867] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:34.175749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331626b-1219-4b58-ab61-eeaa13f3ae31 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.176346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331626b-1219-4b58-ab61-eeaa13f3ae31 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.176430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331626b-1219-4b58-ab61-eeaa13f3ae31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.212818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-f331626b-1219-4b58-ab61-eeaa13f3ae31 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:34.214460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f331626b-1219-4b58-ab61-eeaa13f3ae31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:34.228986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 943/1868] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:34.233233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38daa2-749a-45f2-881d-033a2d8c09e3 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.243577 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38daa2-749a-45f2-881d-033a2d8c09e3 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.248178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a8f5f-9e2f-4b2f-b9ab-7e2c0ff6c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.248826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8f5f-9e2f-4b2f-b9ab-7e2c0ff6c5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.249344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8f5f-9e2f-4b2f-b9ab-7e2c0ff6c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.249678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8f5f-9e2f-4b2f-b9ab-7e2c0ff6c5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.250397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a8f5f-9e2f-4b2f-b9ab-7e2c0ff6c5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:34.250770 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a8f5f-9e2f-4b2f-b9ab-7e2c0ff6c5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.252487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a8f5f-9e2f-4b2f-b9ab-7e2c0ff6c5b2 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.265435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 926/1869] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:14:34.270360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331626b-1219-4b58-ab61-eeaa13f3ae31 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.277990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:34.285315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331626b-1219-4b58-ab61-eeaa13f3ae31 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.292696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5918e6d-adbe-47a4-987f-542393e155ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.293624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5918e6d-adbe-47a4-987f-542393e155ad admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.294194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5918e6d-adbe-47a4-987f-542393e155ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.294692 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5918e6d-adbe-47a4-987f-542393e155ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.295766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5918e6d-adbe-47a4-987f-542393e155ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.297790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5918e6d-adbe-47a4-987f-542393e155ad admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.330822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 944/1870] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:34.331893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a8f5f-9e2f-4b2f-b9ab-7e2c0ff6c5b2 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.343128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a8f5f-9e2f-4b2f-b9ab-7e2c0ff6c5b2 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.410477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b9ed-4dad-4bfb-a949-ebc291b81cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.412058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b9ed-4dad-4bfb-a949-ebc291b81cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.412645 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b9ed-4dad-4bfb-a949-ebc291b81cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.413119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b9ed-4dad-4bfb-a949-ebc291b81cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.413967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393b9ed-4dad-4bfb-a949-ebc291b81cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.416166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393b9ed-4dad-4bfb-a949-ebc291b81cd4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.445502 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 927/1871] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:14:34.449862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5918e6d-adbe-47a4-987f-542393e155ad admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.467031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5918e6d-adbe-47a4-987f-542393e155ad admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.472345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa488f42-9740-4574-bc6e-f5c8696a0f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.473156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa488f42-9740-4574-bc6e-f5c8696a0f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.473444 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa488f42-9740-4574-bc6e-f5c8696a0f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.473715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa488f42-9740-4574-bc6e-f5c8696a0f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.474380 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa488f42-9740-4574-bc6e-f5c8696a0f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.475998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa488f42-9740-4574-bc6e-f5c8696a0f58 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.494968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 945/1872] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:34.500245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b9ed-4dad-4bfb-a949-ebc291b81cd4 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.511652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b9ed-4dad-4bfb-a949-ebc291b81cd4 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.516825 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1736e-0742-42d4-82d7-6ecd13ac24c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.517567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1736e-0742-42d4-82d7-6ecd13ac24c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.517915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1736e-0742-42d4-82d7-6ecd13ac24c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.518247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1736e-0742-42d4-82d7-6ecd13ac24c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.518968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1736e-0742-42d4-82d7-6ecd13ac24c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.520898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1736e-0742-42d4-82d7-6ecd13ac24c9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.533263 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 928/1873] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:14:34.537709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa488f42-9740-4574-bc6e-f5c8696a0f58 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.548350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa488f42-9740-4574-bc6e-f5c8696a0f58 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.553540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41c400-fdae-4c23-9df7-cb19e01c394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.554224 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c400-fdae-4c23-9df7-cb19e01c394e admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.554506 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c400-fdae-4c23-9df7-cb19e01c394e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.554785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c400-fdae-4c23-9df7-cb19e01c394e admin admin] PATH_INFO: `/v3/projects/c24a32eee6c9454dbc048aa5102a5a10/users/01de9534dc7a4d4aa4523c9a164c36e0/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.571704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41c400-fdae-4c23-9df7-cb19e01c394e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24a32eee6c9454dbc048aa5102a5a10, user_id=01de9534dc7a4d4aa4523c9a164c36e0, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.574492 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41c400-fdae-4c23-9df7-cb19e01c394e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.590467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 946/1874] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:14:34 2022] PUT /identity/v3/projects/c24a32eee6c9454dbc048aa5102a5a10/users/01de9534dc7a4d4aa4523c9a164c36e0/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:14:34.601600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db70ea-1b0f-417d-8efc-eb7b0ee6767d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.602011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db70ea-1b0f-417d-8efc-eb7b0ee6767d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.602449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db70ea-1b0f-417d-8efc-eb7b0ee6767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.636335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d2db70ea-1b0f-417d-8efc-eb7b0ee6767d None None] MFA Rules not processed for user `01de9534dc7a4d4aa4523c9a164c36e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:34.637722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d2db70ea-1b0f-417d-8efc-eb7b0ee6767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:34.716164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 929/1875] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:34.728393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41c400-fdae-4c23-9df7-cb19e01c394e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:34.730293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4a41c400-fdae-4c23-9df7-cb19e01c394e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:34.799466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41c400-fdae-4c23-9df7-cb19e01c394e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:34.803344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e36d5f-1ef5-4fca-925a-16f5b2bfb9d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:34.803968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36d5f-1ef5-4fca-925a-16f5b2bfb9d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:34.804251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36d5f-1ef5-4fca-925a-16f5b2bfb9d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:34.804575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36d5f-1ef5-4fca-925a-16f5b2bfb9d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:34.814628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e36d5f-1ef5-4fca-925a-16f5b2bfb9d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:34.818492 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e36d5f-1ef5-4fca-925a-16f5b2bfb9d9 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:34.826980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 947/1876] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:36.312942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658cee-c8f6-4930-81c8-a8c18cfae208 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:36.313494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658cee-c8f6-4930-81c8-a8c18cfae208 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:36.313494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658cee-c8f6-4930-81c8-a8c18cfae208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:36.336038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-43658cee-c8f6-4930-81c8-a8c18cfae208 None None] MFA Rules not processed for user `01de9534dc7a4d4aa4523c9a164c36e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:36.337537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-43658cee-c8f6-4930-81c8-a8c18cfae208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:36.345346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 930/1877] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:36.552006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a76bfc-07ae-444a-988e-525db2a95289 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:36.552604 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a76bfc-07ae-444a-988e-525db2a95289 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:36.553499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a76bfc-07ae-444a-988e-525db2a95289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:36.585369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-43a76bfc-07ae-444a-988e-525db2a95289 None None] MFA Rules not processed for user `0b96ce275ce04db9b46265361e06a483`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:36.586732 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-43a76bfc-07ae-444a-988e-525db2a95289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:36.656345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 948/1878] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:39.163597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658cee-c8f6-4930-81c8-a8c18cfae208 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:39.165781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-43658cee-c8f6-4930-81c8-a8c18cfae208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:39.201526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:39.242777 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658cee-c8f6-4930-81c8-a8c18cfae208 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:39.248790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:39.249597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:39.249876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:39.250139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] PATH_INFO: `/v3/users/6dd31d16274c47989b7daf5ae60c04f1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:39.251400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd31d16274c47989b7daf5ae60c04f1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:39.253370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:39.317779 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd31d16274c47989b7daf5ae60c04f1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:39.326135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd31d16274c47989b7daf5ae60c04f1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:39.339187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd31d16274c47989b7daf5ae60c04f1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:39.340061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd31d16274c47989b7daf5ae60c04f1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:39.341307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd31d16274c47989b7daf5ae60c04f1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:39.356284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 931/1879] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:39 2022] DELETE /identity/v3/users/6dd31d16274c47989b7daf5ae60c04f1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:39.360519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb2e9c-d3c5-441c-813d-97f222d1f6ba None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:39.360948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb2e9c-d3c5-441c-813d-97f222d1f6ba None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:39.361064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb2e9c-d3c5-441c-813d-97f222d1f6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:39.380757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d2bb2e9c-d3c5-441c-813d-97f222d1f6ba None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:39.381983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d2bb2e9c-d3c5-441c-813d-97f222d1f6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:39.428276 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:39.443099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 949/1880] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:39.452829 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:39.454342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:39.513763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805324-fd6a-4ace-8b81-e254df5aa91d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:39.517517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e5bad-7cd6-4b12-a9d8-62d3035d6ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:39.518125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5bad-7cd6-4b12-a9d8-62d3035d6ddb service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:39.518394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5bad-7cd6-4b12-a9d8-62d3035d6ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:39.518654 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5bad-7cd6-4b12-a9d8-62d3035d6ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:39.527998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e5bad-7cd6-4b12-a9d8-62d3035d6ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:39.529447 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e5bad-7cd6-4b12-a9d8-62d3035d6ddb service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:39.539161 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 932/1881] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:40.271115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb2e9c-d3c5-441c-813d-97f222d1f6ba None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:40.273123 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d2bb2e9c-d3c5-441c-813d-97f222d1f6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:40.285394 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb2e9c-d3c5-441c-813d-97f222d1f6ba None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:40.290119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:40.290754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:40.291031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:40.291292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] PATH_INFO: `/v3/projects/bcb7515378f043c6a48afc421af03fe8` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:40.292449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb7515378f043c6a48afc421af03fe8)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:40.294563 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:40.370072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb7515378f043c6a48afc421af03fe8', 'request_id': 'req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:40.379427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb7515378f043c6a48afc421af03fe8', 'request_id': 'req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:40.389979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb7515378f043c6a48afc421af03fe8', 'request_id': 'req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:40.410468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] The token cache is being invalidate because project bcb7515378f043c6a48afc421af03fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:40.410979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:40.411702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:40.413418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 950/1882] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:40 2022] DELETE /identity/v3/projects/bcb7515378f043c6a48afc421af03fe8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:49.536778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=65,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:50.406401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:55.253317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffe201-9f62-4ff5-a118-e99e0fff4866 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:55.253847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffe201-9f62-4ff5-a118-e99e0fff4866 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:55.254050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffe201-9f62-4ff5-a118-e99e0fff4866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:55.274132 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5cffe201-9f62-4ff5-a118-e99e0fff4866 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:55.275409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5cffe201-9f62-4ff5-a118-e99e0fff4866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:55.332720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 933/1883] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:14:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:55.344662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:55.346098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:55.414999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7b8c3-34b9-464f-8424-ef3a882a2b4d admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:55.419834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1164eb-3ada-4aba-b02d-fd326c448d84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:55.420558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1164eb-3ada-4aba-b02d-fd326c448d84 service swift] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:55.420838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1164eb-3ada-4aba-b02d-fd326c448d84 service swift] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:55.421111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1164eb-3ada-4aba-b02d-fd326c448d84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:55.429102 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1164eb-3ada-4aba-b02d-fd326c448d84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:55.430735 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1164eb-3ada-4aba-b02d-fd326c448d84 service swift] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:55.439116 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 951/1884] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:14:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:14:55.982788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06aacc-957d-4c9e-9dc5-7d96196f3a31 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:55.983073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06aacc-957d-4c9e-9dc5-7d96196f3a31 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:55.983346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06aacc-957d-4c9e-9dc5-7d96196f3a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.002890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9a06aacc-957d-4c9e-9dc5-7d96196f3a31 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:56.004116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9a06aacc-957d-4c9e-9dc5-7d96196f3a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:56.012257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 934/1885] 10.222.0.15 () {58 vars in 967 bytes} [Mon Oct 24 13:14:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:56.033071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1164eb-3ada-4aba-b02d-fd326c448d84 service swift] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:56.046387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1164eb-3ada-4aba-b02d-fd326c448d84 service swift] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:56.056615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2c1b3-5b26-4401-b79d-6414dfd64400 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:56.057347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2c1b3-5b26-4401-b79d-6414dfd64400 service swift] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:56.057918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2c1b3-5b26-4401-b79d-6414dfd64400 service swift] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:56.058286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2c1b3-5b26-4401-b79d-6414dfd64400 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.067113 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2c1b3-5b26-4401-b79d-6414dfd64400 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:56.068989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2c1b3-5b26-4401-b79d-6414dfd64400 service swift] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:56.077690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 952/1886] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:14:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:14:56.347679 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d62ec-9686-44e9-983d-43e856b476f4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:56.348155 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d62ec-9686-44e9-983d-43e856b476f4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:56.348245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d62ec-9686-44e9-983d-43e856b476f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.368821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-be6d62ec-9686-44e9-983d-43e856b476f4 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:56.370096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-be6d62ec-9686-44e9-983d-43e856b476f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:56.378007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 935/1887] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:14:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:56.390914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2c1b3-5b26-4401-b79d-6414dfd64400 service swift] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:56.401970 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2c1b3-5b26-4401-b79d-6414dfd64400 service swift] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:56.408157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ce7c9-c6cc-4fb6-bb6c-a956ac2f83aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:56.408805 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ce7c9-c6cc-4fb6-bb6c-a956ac2f83aa service swift] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:56.409084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ce7c9-c6cc-4fb6-bb6c-a956ac2f83aa service swift] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:56.409357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ce7c9-c6cc-4fb6-bb6c-a956ac2f83aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.417778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ce7c9-c6cc-4fb6-bb6c-a956ac2f83aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:56.419369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ce7c9-c6cc-4fb6-bb6c-a956ac2f83aa service swift] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:56.427722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 953/1888] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:14:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:14:56.807592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eac8e2-040f-4656-b9d7-41e09104cc69 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:56.807888 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eac8e2-040f-4656-b9d7-41e09104cc69 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:56.808190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eac8e2-040f-4656-b9d7-41e09104cc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.829853 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-10eac8e2-040f-4656-b9d7-41e09104cc69 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:56.831414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-10eac8e2-040f-4656-b9d7-41e09104cc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:56.839167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 936/1889] 10.222.0.15 () {58 vars in 967 bytes} [Mon Oct 24 13:14:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:56.852636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ce7c9-c6cc-4fb6-bb6c-a956ac2f83aa service swift] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:56.865101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ce7c9-c6cc-4fb6-bb6c-a956ac2f83aa service swift] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:56.872161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8aa97b-e6a8-4c4e-ad59-883290b83162 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:56.872849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aa97b-e6a8-4c4e-ad59-883290b83162 service swift] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:56.873377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aa97b-e6a8-4c4e-ad59-883290b83162 service swift] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:56.873829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aa97b-e6a8-4c4e-ad59-883290b83162 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:56.883088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8aa97b-e6a8-4c4e-ad59-883290b83162 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:56.884961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8aa97b-e6a8-4c4e-ad59-883290b83162 service swift] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:56.894011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 954/1890] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:14:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:14:59.186478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eac8e2-040f-4656-b9d7-41e09104cc69 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:59.188135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-10eac8e2-040f-4656-b9d7-41e09104cc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:59.257536 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eac8e2-040f-4656-b9d7-41e09104cc69 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:59.262048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:59.262675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.262948 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.263219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] PATH_INFO: `/v3/users/01de9534dc7a4d4aa4523c9a164c36e0` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.264338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01de9534dc7a4d4aa4523c9a164c36e0)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:59.266281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:59.319062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01de9534dc7a4d4aa4523c9a164c36e0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:59.326045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01de9534dc7a4d4aa4523c9a164c36e0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:59.337997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01de9534dc7a4d4aa4523c9a164c36e0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:59.338736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01de9534dc7a4d4aa4523c9a164c36e0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:59.339406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01de9534dc7a4d4aa4523c9a164c36e0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:59.354114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 937/1891] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:14:59 2022] DELETE /identity/v3/users/01de9534dc7a4d4aa4523c9a164c36e0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:59.358784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164def-d36d-46d4-a555-4ee697c56982 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.359242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164def-d36d-46d4-a555-4ee697c56982 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.359349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164def-d36d-46d4-a555-4ee697c56982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.379348 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-90164def-d36d-46d4-a555-4ee697c56982 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:59.380587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-90164def-d36d-46d4-a555-4ee697c56982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:59.448861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 955/1892] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:59.458545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:59.460185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:59.467080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:59.520642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d31d1-ab78-4c3e-bb4d-63811490ab70 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:59.525282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7d76a-f42b-4ee2-a394-9e7b9b0851dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:59.525893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7d76a-f42b-4ee2-a394-9e7b9b0851dd service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.526171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7d76a-f42b-4ee2-a394-9e7b9b0851dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.526434 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7d76a-f42b-4ee2-a394-9e7b9b0851dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.536715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7d76a-f42b-4ee2-a394-9e7b9b0851dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:59.538189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7d76a-f42b-4ee2-a394-9e7b9b0851dd service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:59.548220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 938/1893] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:14:59.728179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90164def-d36d-46d4-a555-4ee697c56982 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:59.729674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-90164def-d36d-46d4-a555-4ee697c56982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:59.741769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90164def-d36d-46d4-a555-4ee697c56982 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:59.747254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:59.747898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.748176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.748496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] PATH_INFO: `/v3/projects/c24a32eee6c9454dbc048aa5102a5a10` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.749630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24a32eee6c9454dbc048aa5102a5a10)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:59.751593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:59.798027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:59.801174 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24a32eee6c9454dbc048aa5102a5a10', 'request_id': 'req-e8b7875b-d575-44d0-90e9-1428d8dcc536'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:59.807277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24a32eee6c9454dbc048aa5102a5a10', 'request_id': 'req-e8b7875b-d575-44d0-90e9-1428d8dcc536'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:59.813605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24a32eee6c9454dbc048aa5102a5a10', 'request_id': 'req-e8b7875b-d575-44d0-90e9-1428d8dcc536'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:59.826685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] The token cache is being invalidate because project c24a32eee6c9454dbc048aa5102a5a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:14:59.826965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:59.827578 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e8b7875b-d575-44d0-90e9-1428d8dcc536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:14:59.829094 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 956/1894] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:14:59 2022] DELETE /identity/v3/projects/c24a32eee6c9454dbc048aa5102a5a10 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:14:59.834189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462124-9e8a-4e77-816f-c30fd12f6f37 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.834473 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462124-9e8a-4e77-816f-c30fd12f6f37 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.834750 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462124-9e8a-4e77-816f-c30fd12f6f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.854258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-68462124-9e8a-4e77-816f-c30fd12f6f37 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:59.855465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-68462124-9e8a-4e77-816f-c30fd12f6f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:59.915950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 939/1895] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:59.923670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa87cf9-73cb-4708-9ff3-96c555d9d2e4 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.923954 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa87cf9-73cb-4708-9ff3-96c555d9d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.924226 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa87cf9-73cb-4708-9ff3-96c555d9d2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.944328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8fa87cf9-73cb-4708-9ff3-96c555d9d2e4 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:14:59.945540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8fa87cf9-73cb-4708-9ff3-96c555d9d2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:14:59.953418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 957/1896] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:14:59.958501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68462124-9e8a-4e77-816f-c30fd12f6f37 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:14:59.972978 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68462124-9e8a-4e77-816f-c30fd12f6f37 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:14:59.977903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99f0a3-2fbd-4aa7-a7bf-39e21b75dc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:14:59.978506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f0a3-2fbd-4aa7-a7bf-39e21b75dc34 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:14:59.978785 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f0a3-2fbd-4aa7-a7bf-39e21b75dc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:14:59.979058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f0a3-2fbd-4aa7-a7bf-39e21b75dc34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:14:59.979706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99f0a3-2fbd-4aa7-a7bf-39e21b75dc34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:14:59.980016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99f0a3-2fbd-4aa7-a7bf-39e21b75dc34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:14:59.981650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99f0a3-2fbd-4aa7-a7bf-39e21b75dc34 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:14:59.994216 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 940/1897] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:14:59.999142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa87cf9-73cb-4708-9ff3-96c555d9d2e4 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.009873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa87cf9-73cb-4708-9ff3-96c555d9d2e4 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.015558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782e71f-b8bf-4a35-aba7-cf3d71ddfe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.016166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782e71f-b8bf-4a35-aba7-cf3d71ddfe3e admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.016467 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782e71f-b8bf-4a35-aba7-cf3d71ddfe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.016850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782e71f-b8bf-4a35-aba7-cf3d71ddfe3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.017486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782e71f-b8bf-4a35-aba7-cf3d71ddfe3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.019427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782e71f-b8bf-4a35-aba7-cf3d71ddfe3e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.049946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 958/1898] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:14:59 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:15:00.054234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99f0a3-2fbd-4aa7-a7bf-39e21b75dc34 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.068098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99f0a3-2fbd-4aa7-a7bf-39e21b75dc34 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.126363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bc2f0-c5f1-4e2e-9e3b-9f392f7fa2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.126946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bc2f0-c5f1-4e2e-9e3b-9f392f7fa2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.127202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bc2f0-c5f1-4e2e-9e3b-9f392f7fa2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.127483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bc2f0-c5f1-4e2e-9e3b-9f392f7fa2a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.128173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bc2f0-c5f1-4e2e-9e3b-9f392f7fa2a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.130124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bc2f0-c5f1-4e2e-9e3b-9f392f7fa2a5 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.153319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 941/1899] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:15:00 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:15:00.157522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782e71f-b8bf-4a35-aba7-cf3d71ddfe3e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.168093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782e71f-b8bf-4a35-aba7-cf3d71ddfe3e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.173087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148ffe0-9b84-4bb0-a158-580645940e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.173699 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ffe0-9b84-4bb0-a158-580645940e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.173975 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ffe0-9b84-4bb0-a158-580645940e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.174244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ffe0-9b84-4bb0-a158-580645940e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.174923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148ffe0-9b84-4bb0-a158-580645940e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.176596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148ffe0-9b84-4bb0-a158-580645940e25 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.187064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 959/1900] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:00.191219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bc2f0-c5f1-4e2e-9e3b-9f392f7fa2a5 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.201558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bc2f0-c5f1-4e2e-9e3b-9f392f7fa2a5 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.206844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef264d22-f17c-4caf-927e-07ec19b44259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.207452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef264d22-f17c-4caf-927e-07ec19b44259 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.207720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef264d22-f17c-4caf-927e-07ec19b44259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.207997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef264d22-f17c-4caf-927e-07ec19b44259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.208726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef264d22-f17c-4caf-927e-07ec19b44259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.210283 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef264d22-f17c-4caf-927e-07ec19b44259 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.221534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 942/1901] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:00.225942 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148ffe0-9b84-4bb0-a158-580645940e25 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.236213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148ffe0-9b84-4bb0-a158-580645940e25 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.241551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e01450-0757-47d0-8e24-02b3c47705dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.242201 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e01450-0757-47d0-8e24-02b3c47705dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.242481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e01450-0757-47d0-8e24-02b3c47705dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.242753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e01450-0757-47d0-8e24-02b3c47705dc admin admin] PATH_INFO: `/v3/projects/599f774799bf4043a9861fca3db2a9f0/users/f1050dc4b2c341b8ad6bed0f47be9678/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.258778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e01450-0757-47d0-8e24-02b3c47705dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=599f774799bf4043a9861fca3db2a9f0, user_id=f1050dc4b2c341b8ad6bed0f47be9678, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.261399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e01450-0757-47d0-8e24-02b3c47705dc admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.275464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 960/1902] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:00 2022] PUT /identity/v3/projects/599f774799bf4043a9861fca3db2a9f0/users/f1050dc4b2c341b8ad6bed0f47be9678/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:00.286972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d09fb-bb14-4590-b272-8688f841861a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.287260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d09fb-bb14-4590-b272-8688f841861a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.287527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d09fb-bb14-4590-b272-8688f841861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.313744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:00.316916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-463d09fb-bb14-4590-b272-8688f841861a None None] MFA Rules not processed for user `f1050dc4b2c341b8ad6bed0f47be9678`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:00.319180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-463d09fb-bb14-4590-b272-8688f841861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:00.385541 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 943/1903] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:15:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:00.397334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e01450-0757-47d0-8e24-02b3c47705dc admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:00.399263 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-34e01450-0757-47d0-8e24-02b3c47705dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:00.455917 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e01450-0757-47d0-8e24-02b3c47705dc admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:00.462930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b316bc-0bb7-4eb4-8ba2-7e7b00d42610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:00.463685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b316bc-0bb7-4eb4-8ba2-7e7b00d42610 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:00.464034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b316bc-0bb7-4eb4-8ba2-7e7b00d42610 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:00.464428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b316bc-0bb7-4eb4-8ba2-7e7b00d42610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:00.477798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b316bc-0bb7-4eb4-8ba2-7e7b00d42610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:00.479995 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b316bc-0bb7-4eb4-8ba2-7e7b00d42610 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:00.492172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 961/1904] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:05.553931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d09fb-bb14-4590-b272-8688f841861a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:05.621739 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d09fb-bb14-4590-b272-8688f841861a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:05.630420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:05.631234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:05.631552 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:05.631863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] PATH_INFO: `/v3/users/f1050dc4b2c341b8ad6bed0f47be9678` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:05.633503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1050dc4b2c341b8ad6bed0f47be9678)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:05.636607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:05.685748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1050dc4b2c341b8ad6bed0f47be9678'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:05.692406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1050dc4b2c341b8ad6bed0f47be9678'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:05.703784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1050dc4b2c341b8ad6bed0f47be9678'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:05.704471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1050dc4b2c341b8ad6bed0f47be9678'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:05.705062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1050dc4b2c341b8ad6bed0f47be9678'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:05.718558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 944/1905] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:15:05 2022] DELETE /identity/v3/users/f1050dc4b2c341b8ad6bed0f47be9678 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:05.723188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcc6e8-c844-4e26-9f04-0caaee84268d None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:05.723715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcc6e8-c844-4e26-9f04-0caaee84268d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:05.723715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcc6e8-c844-4e26-9f04-0caaee84268d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:05.742858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-89dcc6e8-c844-4e26-9f04-0caaee84268d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:05.744042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-89dcc6e8-c844-4e26-9f04-0caaee84268d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:05.803041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 962/1906] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:15:05.813354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:05.815045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:05.841514 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:05.875890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58a095-b5dd-42c3-8e24-e2c3a2c0a7a8 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:05.879809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8672994-48bd-45a9-80bd-ba97c19b0419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:05.880450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8672994-48bd-45a9-80bd-ba97c19b0419 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:05.880724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8672994-48bd-45a9-80bd-ba97c19b0419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:05.880994 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8672994-48bd-45a9-80bd-ba97c19b0419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:05.890351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8672994-48bd-45a9-80bd-ba97c19b0419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:05.891731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8672994-48bd-45a9-80bd-ba97c19b0419 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:05.901381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 945/1907] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:06.177394 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcc6e8-c844-4e26-9f04-0caaee84268d None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.178911 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-89dcc6e8-c844-4e26-9f04-0caaee84268d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:06.200960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcc6e8-c844-4e26-9f04-0caaee84268d None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.206863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.207508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.207787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.208056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] PATH_INFO: `/v3/projects/599f774799bf4043a9861fca3db2a9f0` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.209327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=599f774799bf4043a9861fca3db2a9f0)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.211280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.220416 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:06.263897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599f774799bf4043a9861fca3db2a9f0', 'request_id': 'req-394d5409-d147-49a6-b831-968a6b127fee'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:06.269794 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599f774799bf4043a9861fca3db2a9f0', 'request_id': 'req-394d5409-d147-49a6-b831-968a6b127fee'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:06.276517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599f774799bf4043a9861fca3db2a9f0', 'request_id': 'req-394d5409-d147-49a6-b831-968a6b127fee'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:06.290676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] The token cache is being invalidate because project 599f774799bf4043a9861fca3db2a9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:15:06.291050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:06.291729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-394d5409-d147-49a6-b831-968a6b127fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:15:06.293266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 963/1908] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:15:06 2022] DELETE /identity/v3/projects/599f774799bf4043a9861fca3db2a9f0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:06.298452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c8489-1256-4c51-9ecc-b56677c2a737 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.298738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c8489-1256-4c51-9ecc-b56677c2a737 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.299012 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c8489-1256-4c51-9ecc-b56677c2a737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.319896 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f17c8489-1256-4c51-9ecc-b56677c2a737 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:06.321304 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f17c8489-1256-4c51-9ecc-b56677c2a737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:06.380833 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 946/1909] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:06.388791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafecc9e-928f-497b-8e2d-f9d10eecd324 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.389146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafecc9e-928f-497b-8e2d-f9d10eecd324 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.389486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafecc9e-928f-497b-8e2d-f9d10eecd324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.409832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-cafecc9e-928f-497b-8e2d-f9d10eecd324 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:06.411114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cafecc9e-928f-497b-8e2d-f9d10eecd324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:06.419063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 964/1910] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:06.423409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c8489-1256-4c51-9ecc-b56677c2a737 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.433561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c8489-1256-4c51-9ecc-b56677c2a737 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.438875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879b7c9-c959-48c9-9a79-43c4d8b8aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.439475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879b7c9-c959-48c9-9a79-43c4d8b8aab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.439751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879b7c9-c959-48c9-9a79-43c4d8b8aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.440016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879b7c9-c959-48c9-9a79-43c4d8b8aab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.440743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879b7c9-c959-48c9-9a79-43c4d8b8aab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:15:06.441042 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879b7c9-c959-48c9-9a79-43c4d8b8aab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.442643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879b7c9-c959-48c9-9a79-43c4d8b8aab4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.454151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 947/1911] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:15:06.459007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafecc9e-928f-497b-8e2d-f9d10eecd324 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.468318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafecc9e-928f-497b-8e2d-f9d10eecd324 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.474140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93129-3652-46ec-a231-50abaab8e945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.474758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93129-3652-46ec-a231-50abaab8e945 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.475032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93129-3652-46ec-a231-50abaab8e945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.475300 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93129-3652-46ec-a231-50abaab8e945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.475928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b93129-3652-46ec-a231-50abaab8e945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.477868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b93129-3652-46ec-a231-50abaab8e945 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.506636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 965/1912] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:15:06 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:15:06.510964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879b7c9-c959-48c9-9a79-43c4d8b8aab4 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.522066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879b7c9-c959-48c9-9a79-43c4d8b8aab4 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.585592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd7bec-e52d-4c3b-966d-19f59376c3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.586330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd7bec-e52d-4c3b-966d-19f59376c3bc admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.586481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd7bec-e52d-4c3b-966d-19f59376c3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.586741 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd7bec-e52d-4c3b-966d-19f59376c3bc admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.587365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd7bec-e52d-4c3b-966d-19f59376c3bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.589407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd7bec-e52d-4c3b-966d-19f59376c3bc admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.611511 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 948/1913] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:15:06 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:15:06.616408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93129-3652-46ec-a231-50abaab8e945 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.627184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93129-3652-46ec-a231-50abaab8e945 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.632802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222beb-a931-40bb-a066-e39e2a4d1e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.633414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222beb-a931-40bb-a066-e39e2a4d1e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.633695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222beb-a931-40bb-a066-e39e2a4d1e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.633969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222beb-a931-40bb-a066-e39e2a4d1e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.634682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d222beb-a931-40bb-a066-e39e2a4d1e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.636323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d222beb-a931-40bb-a066-e39e2a4d1e21 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.646768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 966/1914] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:15:06.651847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd7bec-e52d-4c3b-966d-19f59376c3bc admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.663307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd7bec-e52d-4c3b-966d-19f59376c3bc admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.668683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821a26f-6c8a-48f0-92a2-df936a43fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.669290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821a26f-6c8a-48f0-92a2-df936a43fe8d admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.669568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821a26f-6c8a-48f0-92a2-df936a43fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.669836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821a26f-6c8a-48f0-92a2-df936a43fe8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.670483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821a26f-6c8a-48f0-92a2-df936a43fe8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.672107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821a26f-6c8a-48f0-92a2-df936a43fe8d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.683991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 949/1915] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:06.688203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222beb-a931-40bb-a066-e39e2a4d1e21 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.698389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222beb-a931-40bb-a066-e39e2a4d1e21 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.703330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b804b4e-4dcb-4a8f-99ff-0594a831a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.703992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b804b4e-4dcb-4a8f-99ff-0594a831a9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.704268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b804b4e-4dcb-4a8f-99ff-0594a831a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.704590 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b804b4e-4dcb-4a8f-99ff-0594a831a9ec admin admin] PATH_INFO: `/v3/projects/a2b4860b53824bbd998533a60570b0ff/users/57decc229903408e873b5d976fd309c2/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.719961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b804b4e-4dcb-4a8f-99ff-0594a831a9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b4860b53824bbd998533a60570b0ff, user_id=57decc229903408e873b5d976fd309c2, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.723433 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b804b4e-4dcb-4a8f-99ff-0594a831a9ec admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.738939 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 967/1916] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:06 2022] PUT /identity/v3/projects/a2b4860b53824bbd998533a60570b0ff/users/57decc229903408e873b5d976fd309c2/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:06.744413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe218e2-8bab-4961-a1fd-40ab6ba0a179 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.744704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe218e2-8bab-4961-a1fd-40ab6ba0a179 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.744972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe218e2-8bab-4961-a1fd-40ab6ba0a179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.764430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-cbe218e2-8bab-4961-a1fd-40ab6ba0a179 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:06.765634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cbe218e2-8bab-4961-a1fd-40ab6ba0a179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:06.791518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:06.835265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 950/1917] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:06.845262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b804b4e-4dcb-4a8f-99ff-0594a831a9ec admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:06.847390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4b804b4e-4dcb-4a8f-99ff-0594a831a9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:06.905385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b804b4e-4dcb-4a8f-99ff-0594a831a9ec admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:06.909623 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98899b57-9fb3-4ef6-bde2-65cd4860b938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:06.910228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98899b57-9fb3-4ef6-bde2-65cd4860b938 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:06.910532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98899b57-9fb3-4ef6-bde2-65cd4860b938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:06.910788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98899b57-9fb3-4ef6-bde2-65cd4860b938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:06.924469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98899b57-9fb3-4ef6-bde2-65cd4860b938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:06.926629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98899b57-9fb3-4ef6-bde2-65cd4860b938 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:06.941329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 968/1918] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:11.091606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf2c2c-8526-43c4-9125-b93057f6b0e4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:11.092036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf2c2c-8526-43c4-9125-b93057f6b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:11.092036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf2c2c-8526-43c4-9125-b93057f6b0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:11.123996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3edf2c2c-8526-43c4-9125-b93057f6b0e4 None None] MFA Rules not processed for user `57decc229903408e873b5d976fd309c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:11.126887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3edf2c2c-8526-43c4-9125-b93057f6b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:11.211546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98899b57-9fb3-4ef6-bde2-65cd4860b938 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:11.216791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 951/1919] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:15:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:11.222742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98899b57-9fb3-4ef6-bde2-65cd4860b938 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:11.227792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c22e76-a504-462a-8faf-d4d1f16f0bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:11.228570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c22e76-a504-462a-8faf-d4d1f16f0bac admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:11.228932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c22e76-a504-462a-8faf-d4d1f16f0bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:11.229369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c22e76-a504-462a-8faf-d4d1f16f0bac admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:11.230119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c22e76-a504-462a-8faf-d4d1f16f0bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:11.232163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c22e76-a504-462a-8faf-d4d1f16f0bac admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:11.264412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 969/1920] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:15:11 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:15:11.268231 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf2c2c-8526-43c4-9125-b93057f6b0e4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:11.284642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf2c2c-8526-43c4-9125-b93057f6b0e4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:11.341721 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe984f-889e-4b46-9702-4a68fa3e0f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:11.342316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe984f-889e-4b46-9702-4a68fa3e0f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:11.342589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe984f-889e-4b46-9702-4a68fa3e0f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:11.342857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe984f-889e-4b46-9702-4a68fa3e0f8d admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:11.343503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe984f-889e-4b46-9702-4a68fa3e0f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:11.345544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe984f-889e-4b46-9702-4a68fa3e0f8d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:11.382063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 952/1921] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:15:11 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:15:11.386857 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c22e76-a504-462a-8faf-d4d1f16f0bac admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:11.397472 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c22e76-a504-462a-8faf-d4d1f16f0bac admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:11.406295 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c91855-8b5b-40e6-8243-fe03a06cf9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:11.407148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c91855-8b5b-40e6-8243-fe03a06cf9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:11.407429 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c91855-8b5b-40e6-8243-fe03a06cf9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:11.407718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c91855-8b5b-40e6-8243-fe03a06cf9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:11.408784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c91855-8b5b-40e6-8243-fe03a06cf9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:11.410158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c91855-8b5b-40e6-8243-fe03a06cf9a6 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:11.423880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 970/1922] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:11.428109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe984f-889e-4b46-9702-4a68fa3e0f8d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:11.438688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe984f-889e-4b46-9702-4a68fa3e0f8d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:11.443520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236dcc3-a629-4834-b8f3-83c1b664b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:11.444193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236dcc3-a629-4834-b8f3-83c1b664b9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:11.444507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236dcc3-a629-4834-b8f3-83c1b664b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:11.444781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236dcc3-a629-4834-b8f3-83c1b664b9dc admin admin] PATH_INFO: `/v3/projects/dc28c6bf0eef469388323be69760b076/users/479866c6e7b84004841c295be59bf439/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:11.461237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236dcc3-a629-4834-b8f3-83c1b664b9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc28c6bf0eef469388323be69760b076, user_id=479866c6e7b84004841c295be59bf439, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:11.464000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236dcc3-a629-4834-b8f3-83c1b664b9dc admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:11.482708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 953/1923] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:11 2022] PUT /identity/v3/projects/dc28c6bf0eef469388323be69760b076/users/479866c6e7b84004841c295be59bf439/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:11.486791 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c91855-8b5b-40e6-8243-fe03a06cf9a6 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:11.492698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:11.499699 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c91855-8b5b-40e6-8243-fe03a06cf9a6 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:11.558764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d221ce-dd80-4087-857f-ec4a7652e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:11.559386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d221ce-dd80-4087-857f-ec4a7652e543 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:11.559663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d221ce-dd80-4087-857f-ec4a7652e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:11.559933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d221ce-dd80-4087-857f-ec4a7652e543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:11.560626 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d221ce-dd80-4087-857f-ec4a7652e543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:11.562255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d221ce-dd80-4087-857f-ec4a7652e543 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:11.573169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 971/1924] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:15:11.577396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236dcc3-a629-4834-b8f3-83c1b664b9dc admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:11.589603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236dcc3-a629-4834-b8f3-83c1b664b9dc admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:11.594362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4635-731c-4a36-bb08-31f085c7334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:11.595048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4635-731c-4a36-bb08-31f085c7334c admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:11.595329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4635-731c-4a36-bb08-31f085c7334c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:11.595601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4635-731c-4a36-bb08-31f085c7334c admin admin] PATH_INFO: `/v3/projects/dc28c6bf0eef469388323be69760b076/users/479866c6e7b84004841c295be59bf439/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:11.597845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c4635-731c-4a36-bb08-31f085c7334c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc28c6bf0eef469388323be69760b076, user_id=479866c6e7b84004841c295be59bf439, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:11.600637 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c4635-731c-4a36-bb08-31f085c7334c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:11.612966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 954/1925] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:15:11 2022] PUT /identity/v3/projects/dc28c6bf0eef469388323be69760b076/users/479866c6e7b84004841c295be59bf439/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:15:16.039119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb5f8-695e-4218-8072-4e90a62fc1a0 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:16.039661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb5f8-695e-4218-8072-4e90a62fc1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:16.039661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb5f8-695e-4218-8072-4e90a62fc1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:16.069166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-035cb5f8-695e-4218-8072-4e90a62fc1a0 None None] MFA Rules not processed for user `479866c6e7b84004841c295be59bf439`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:16.070428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-035cb5f8-695e-4218-8072-4e90a62fc1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:16.146293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 972/1926] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:15:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:15:16.160763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4635-731c-4a36-bb08-31f085c7334c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:16.162880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c42c4635-731c-4a36-bb08-31f085c7334c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:16.179371 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:16.263345 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4635-731c-4a36-bb08-31f085c7334c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:16.277043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f876b3-da03-4e14-961d-7d32f1a29563 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47768a5f86d4c6292099691f6cab1e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:16.277682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f876b3-da03-4e14-961d-7d32f1a29563 service glance] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:16.277958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f876b3-da03-4e14-961d-7d32f1a29563 service glance] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:16.278229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f876b3-da03-4e14-961d-7d32f1a29563 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:16.353138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f876b3-da03-4e14-961d-7d32f1a29563 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:16.355198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f876b3-da03-4e14-961d-7d32f1a29563 service glance] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:16.367681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 955/1927] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:16.540686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6a13e-6e26-4ea6-a07d-c3034ac7e5ae None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:16.541219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6a13e-6e26-4ea6-a07d-c3034ac7e5ae None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:16.541882 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6a13e-6e26-4ea6-a07d-c3034ac7e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:16.566135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b2f6a13e-6e26-4ea6-a07d-c3034ac7e5ae None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:16.569213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b2f6a13e-6e26-4ea6-a07d-c3034ac7e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:16.633379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 973/1928] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:15:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:16.659911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f876b3-da03-4e14-961d-7d32f1a29563 service glance] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:16.661804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-39f876b3-da03-4e14-961d-7d32f1a29563 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:16.742001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f876b3-da03-4e14-961d-7d32f1a29563 service glance] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:16.746965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1513e-c4d3-42f8-a42e-eb3b0c467dd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:16.747612 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1513e-c4d3-42f8-a42e-eb3b0c467dd5 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:16.747887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1513e-c4d3-42f8-a42e-eb3b0c467dd5 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:16.748156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1513e-c4d3-42f8-a42e-eb3b0c467dd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:16.757075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1513e-c4d3-42f8-a42e-eb3b0c467dd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:16.758668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1513e-c4d3-42f8-a42e-eb3b0c467dd5 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:16.767669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 956/1929] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:15:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:15:25.426661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1e08-5b1d-4723-bb3c-50f7e340f183 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:25.427653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1e08-5b1d-4723-bb3c-50f7e340f183 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:25.427932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1e08-5b1d-4723-bb3c-50f7e340f183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:25.476120 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ec7b1e08-5b1d-4723-bb3c-50f7e340f183 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:25.477904 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ec7b1e08-5b1d-4723-bb3c-50f7e340f183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:25.491220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 974/1930] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:15:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:25.507828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1513e-c4d3-42f8-a42e-eb3b0c467dd5 service swift] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:25.531819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1513e-c4d3-42f8-a42e-eb3b0c467dd5 service swift] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:25.541887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef59ff3-d1c1-49a6-b9cf-a47e7a1adf29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:25.543095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef59ff3-d1c1-49a6-b9cf-a47e7a1adf29 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:25.543397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef59ff3-d1c1-49a6-b9cf-a47e7a1adf29 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:25.543790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef59ff3-d1c1-49a6-b9cf-a47e7a1adf29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:25.560166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef59ff3-d1c1-49a6-b9cf-a47e7a1adf29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:25.561979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef59ff3-d1c1-49a6-b9cf-a47e7a1adf29 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:25.575924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 957/1931] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:15:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:15:27.417001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc07229-3497-40d1-abf6-d359a8e932ec None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:27.418180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc07229-3497-40d1-abf6-d359a8e932ec None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:27.418667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc07229-3497-40d1-abf6-d359a8e932ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:27.440487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4dc07229-3497-40d1-abf6-d359a8e932ec None None] MFA Rules not processed for user `57decc229903408e873b5d976fd309c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:27.442783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4dc07229-3497-40d1-abf6-d359a8e932ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:27.452174 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 975/1932] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:15:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:15:31.349072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeba5e-3c77-4813-bfb9-b0541dbadac9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.350001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeba5e-3c77-4813-bfb9-b0541dbadac9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.350426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeba5e-3c77-4813-bfb9-b0541dbadac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.404273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c0aeba5e-3c77-4813-bfb9-b0541dbadac9 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:31.406041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c0aeba5e-3c77-4813-bfb9-b0541dbadac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:31.433585 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 958/1933] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:15:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:31.441902 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc07229-3497-40d1-abf6-d359a8e932ec None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:31.470522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc07229-3497-40d1-abf6-d359a8e932ec None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:31.478316 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f54027-6928-4479-8c3f-c8f6d4e53c76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:31.478979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f54027-6928-4479-8c3f-c8f6d4e53c76 service swift] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:31.479257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f54027-6928-4479-8c3f-c8f6d4e53c76 service swift] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:31.479526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f54027-6928-4479-8c3f-c8f6d4e53c76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:31.488673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f54027-6928-4479-8c3f-c8f6d4e53c76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:31.490571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f54027-6928-4479-8c3f-c8f6d4e53c76 service swift] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:31.499771 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 976/1934] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:15:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:15:34.648192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeba5e-3c77-4813-bfb9-b0541dbadac9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:34.650545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c0aeba5e-3c77-4813-bfb9-b0541dbadac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:34.746003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:34.788104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeba5e-3c77-4813-bfb9-b0541dbadac9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:34.795099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37d5b9-f185-442a-8547-660cc8fa3a34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:34.796246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37d5b9-f185-442a-8547-660cc8fa3a34 service placement] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:34.796758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37d5b9-f185-442a-8547-660cc8fa3a34 service placement] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:34.797173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37d5b9-f185-442a-8547-660cc8fa3a34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:34.799510 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1f37d5b9-f185-442a-8547-660cc8fa3a34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:34.814041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37d5b9-f185-442a-8547-660cc8fa3a34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:34.815936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37d5b9-f185-442a-8547-660cc8fa3a34 service placement] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:34.843353 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 959/1935] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:41.495533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:44.822563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=15 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:47.316186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47363018-56ba-4221-a47e-ad0ef892da93 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:47.316766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47363018-56ba-4221-a47e-ad0ef892da93 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:47.316896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47363018-56ba-4221-a47e-ad0ef892da93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:47.339298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-47363018-56ba-4221-a47e-ad0ef892da93 None None] MFA Rules not processed for user `8d4c78fc725b440eb266b0365cbfcedd`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:47.340579 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-47363018-56ba-4221-a47e-ad0ef892da93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:47.397640 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 977/1936] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:15:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:49.884538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e54fe-b6d2-4c49-a2b4-08692e7de7b9 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:49.885078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e54fe-b6d2-4c49-a2b4-08692e7de7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:49.885198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e54fe-b6d2-4c49-a2b4-08692e7de7b9 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:49.886553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 960/1937] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:15:49.893812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885fd8d-005e-471a-84e8-9f823badaf64 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:49.894338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885fd8d-005e-471a-84e8-9f823badaf64 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:49.894338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885fd8d-005e-471a-84e8-9f823badaf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:49.913616 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-1885fd8d-005e-471a-84e8-9f823badaf64 None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:49.915021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1885fd8d-005e-471a-84e8-9f823badaf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:49.988764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 978/1938] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:15:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:50.002851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e54fe-b6d2-4c49-a2b4-08692e7de7b9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:50.014704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e54fe-b6d2-4c49-a2b4-08692e7de7b9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:50.018518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f668946-9a27-41f3-8efd-6382dfa8ba7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47768a5f86d4c6292099691f6cab1e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:50.019261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668946-9a27-41f3-8efd-6382dfa8ba7c service glance] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:50.019538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668946-9a27-41f3-8efd-6382dfa8ba7c service glance] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:50.020264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668946-9a27-41f3-8efd-6382dfa8ba7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:50.032478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f668946-9a27-41f3-8efd-6382dfa8ba7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:50.033083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f668946-9a27-41f3-8efd-6382dfa8ba7c service glance] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:50.047381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 961/1939] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:50.120100 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea2af-f308-4bd1-9eb9-6e7afc90fda3 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:50.120473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea2af-f308-4bd1-9eb9-6e7afc90fda3 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:50.120757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea2af-f308-4bd1-9eb9-6e7afc90fda3 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:50.122176 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 979/1940] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:15:50.127981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f88774-ca48-4fcf-8c96-28cb2cf8bf59 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:50.128267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f88774-ca48-4fcf-8c96-28cb2cf8bf59 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:50.128686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f88774-ca48-4fcf-8c96-28cb2cf8bf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:50.154946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-03f88774-ca48-4fcf-8c96-28cb2cf8bf59 None None] MFA Rules not processed for user `974f2acdadf14df69cbe33351ee02a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:50.156165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-03f88774-ca48-4fcf-8c96-28cb2cf8bf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:50.334719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 962/1941] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:15:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:50.353585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ea2af-f308-4bd1-9eb9-6e7afc90fda3 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:50.356403 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d41ea2af-f308-4bd1-9eb9-6e7afc90fda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:50.383702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ea2af-f308-4bd1-9eb9-6e7afc90fda3 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:50.392272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9b378-acc8-4c5a-a07e-7d7f5aa9e3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:50.393170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9b378-acc8-4c5a-a07e-7d7f5aa9e3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:50.393596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9b378-acc8-4c5a-a07e-7d7f5aa9e3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:50.394035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9b378-acc8-4c5a-a07e-7d7f5aa9e3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:50.403186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9b378-acc8-4c5a-a07e-7d7f5aa9e3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:50.404685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9b378-acc8-4c5a-a07e-7d7f5aa9e3d5 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:50.415179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 980/1942] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:50.536081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1a417-930c-4900-b478-6241dc4b5a74 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:50.536409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1a417-930c-4900-b478-6241dc4b5a74 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:50.536691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1a417-930c-4900-b478-6241dc4b5a74 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:50.538286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 963/1943] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:15:50.551654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac463e9-9716-4cbe-a75b-d0e28caf340f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:50.552684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac463e9-9716-4cbe-a75b-d0e28caf340f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:50.553134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac463e9-9716-4cbe-a75b-d0e28caf340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:50.580700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-8ac463e9-9716-4cbe-a75b-d0e28caf340f None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:50.582135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8ac463e9-9716-4cbe-a75b-d0e28caf340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:50.593785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 981/1944] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:15:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:50.606448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1a417-930c-4900-b478-6241dc4b5a74 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:50.618417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1a417-930c-4900-b478-6241dc4b5a74 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:50.622011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c3a2b-b0b1-487a-8c65-c4eaf5827afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:50.622854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c3a2b-b0b1-487a-8c65-c4eaf5827afe service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:50.623145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c3a2b-b0b1-487a-8c65-c4eaf5827afe service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:50.623422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c3a2b-b0b1-487a-8c65-c4eaf5827afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:50.634663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c3a2b-b0b1-487a-8c65-c4eaf5827afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:50.636113 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c3a2b-b0b1-487a-8c65-c4eaf5827afe service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:50.647094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 964/1945] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:15:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:15:54.886453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb708db-72ea-4c0a-b327-9fa4e701b88a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:54.886919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb708db-72ea-4c0a-b327-9fa4e701b88a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:54.887013 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb708db-72ea-4c0a-b327-9fa4e701b88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:54.906522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-bfb708db-72ea-4c0a-b327-9fa4e701b88a None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:15:54.907794 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bfb708db-72ea-4c0a-b327-9fa4e701b88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:15:54.915090 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 982/1946] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:15:54.927118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c3a2b-b0b1-487a-8c65-c4eaf5827afe service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:15:54.938622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c3a2b-b0b1-487a-8c65-c4eaf5827afe service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:15:54.943658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ee8d2-7e47-4bb7-b818-b56405d935e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:15:54.944509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ee8d2-7e47-4bb7-b818-b56405d935e2 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:15:54.944855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ee8d2-7e47-4bb7-b818-b56405d935e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:15:54.945219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ee8d2-7e47-4bb7-b818-b56405d935e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:15:54.953919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ee8d2-7e47-4bb7-b818-b56405d935e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:15:54.955628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ee8d2-7e47-4bb7-b818-b56405d935e2 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:15:54.963830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 965/1947] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:15:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:16:04.901041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=68 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:04.961004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=41 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:09.186404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eed223-5f71-49b1-b31f-81070c52f458 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:09.186958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eed223-5f71-49b1-b31f-81070c52f458 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:09.186958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eed223-5f71-49b1-b31f-81070c52f458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:09.206840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b0eed223-5f71-49b1-b31f-81070c52f458 None None] MFA Rules not processed for user `0b96ce275ce04db9b46265361e06a483`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:09.208058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b0eed223-5f71-49b1-b31f-81070c52f458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:09.271602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 983/1948] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:16:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:16:10.834783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ee8d2-7e47-4bb7-b818-b56405d935e2 service swift] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:16:10.844735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ee8d2-7e47-4bb7-b818-b56405d935e2 service swift] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:16:10.848595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd3948-34bb-44e0-a486-a5e66adbca6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:16:10.849209 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd3948-34bb-44e0-a486-a5e66adbca6c service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:10.849491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd3948-34bb-44e0-a486-a5e66adbca6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:10.849766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd3948-34bb-44e0-a486-a5e66adbca6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:10.859805 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd3948-34bb-44e0-a486-a5e66adbca6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:16:10.861383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd3948-34bb-44e0-a486-a5e66adbca6c service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:16:10.871660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 966/1949] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:16:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:16:12.652544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d45b1-05ec-4467-99c1-dde4a9fe7952 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:12.652544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d45b1-05ec-4467-99c1-dde4a9fe7952 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:12.653191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d45b1-05ec-4467-99c1-dde4a9fe7952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:12.674213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-1d1d45b1-05ec-4467-99c1-dde4a9fe7952 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:12.675590 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1d1d45b1-05ec-4467-99c1-dde4a9fe7952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:12.683209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 984/1950] 10.222.0.15 () {58 vars in 967 bytes} [Mon Oct 24 13:16:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:16:12.695444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd3948-34bb-44e0-a486-a5e66adbca6c service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:16:12.706654 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd3948-34bb-44e0-a486-a5e66adbca6c service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:16:12.711702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b838df-69e7-42b3-8a86-81bd849bf177 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:16:12.712322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b838df-69e7-42b3-8a86-81bd849bf177 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:12.712648 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b838df-69e7-42b3-8a86-81bd849bf177 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:12.712919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b838df-69e7-42b3-8a86-81bd849bf177 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:12.727340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b838df-69e7-42b3-8a86-81bd849bf177 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:16:12.730274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b838df-69e7-42b3-8a86-81bd849bf177 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:16:12.743598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 967/1951] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:16:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:16:22.668214 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=28 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:22.737808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=12 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:38.467720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c05d8-f864-4dec-9ed4-09e13b1842f9 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:16:38.468320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c05d8-f864-4dec-9ed4-09e13b1842f9 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:16:38.468432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c05d8-f864-4dec-9ed4-09e13b1842f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:16:38.488832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-cf3c05d8-f864-4dec-9ed4-09e13b1842f9 None None] MFA Rules not processed for user `169da6fc9b04431a9fcf7580c65ab1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:16:38.490040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cf3c05d8-f864-4dec-9ed4-09e13b1842f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:16:38.546900 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 985/1952] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:16:48.539893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=25 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:07.065908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59785a-5d18-4dcf-b77e-f4e2fbed2c3a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:07.066978 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59785a-5d18-4dcf-b77e-f4e2fbed2c3a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:07.067607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59785a-5d18-4dcf-b77e-f4e2fbed2c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:07.089468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9e59785a-5d18-4dcf-b77e-f4e2fbed2c3a None None] MFA Rules not processed for user `51360e31ecb2426aaa32981a54f71fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:07.090939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9e59785a-5d18-4dcf-b77e-f4e2fbed2c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:07.152818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 968/1953] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:12.339529 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9f8f6-e6d1-4abb-a6fd-c358704da513 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:12.340010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9f8f6-e6d1-4abb-a6fd-c358704da513 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:12.340131 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9f8f6-e6d1-4abb-a6fd-c358704da513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:12.363560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-00b9f8f6-e6d1-4abb-a6fd-c358704da513 None None] MFA Rules not processed for user `8d4c78fc725b440eb266b0365cbfcedd`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:12.364919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-00b9f8f6-e6d1-4abb-a6fd-c358704da513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:12.373106 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 986/1954] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:17.144714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=25 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:21.881014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59785a-5d18-4dcf-b77e-f4e2fbed2c3a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:21.882457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9e59785a-5d18-4dcf-b77e-f4e2fbed2c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:21.954884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59785a-5d18-4dcf-b77e-f4e2fbed2c3a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:21.959361 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:21.959993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:21.960257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:21.960556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] PATH_INFO: `/v3/users/0b96ce275ce04db9b46265361e06a483` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:21.961798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b96ce275ce04db9b46265361e06a483)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:21.963774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:22.011823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b96ce275ce04db9b46265361e06a483'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:22.019667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b96ce275ce04db9b46265361e06a483'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:22.044431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b96ce275ce04db9b46265361e06a483'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:22.045189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b96ce275ce04db9b46265361e06a483'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:22.045839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9c7ee6e3-a433-4ff4-87b0-5900538840d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b96ce275ce04db9b46265361e06a483'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:22.063879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 969/1955] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:21 2022] DELETE /identity/v3/users/0b96ce275ce04db9b46265361e06a483 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:22.246246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9f8f6-e6d1-4abb-a6fd-c358704da513 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:22.259894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9f8f6-e6d1-4abb-a6fd-c358704da513 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:22.333556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:22.334186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:22.334470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:22.334772 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] PATH_INFO: `/v3/projects/307c102be16c4757889a20c68e7b6544` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:22.335946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=307c102be16c4757889a20c68e7b6544)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:22.337991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:22.398199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307c102be16c4757889a20c68e7b6544', 'request_id': 'req-bef67d5f-38f3-4f16-abcd-080abdcef0ee'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:22.405517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307c102be16c4757889a20c68e7b6544', 'request_id': 'req-bef67d5f-38f3-4f16-abcd-080abdcef0ee'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:22.412407 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307c102be16c4757889a20c68e7b6544', 'request_id': 'req-bef67d5f-38f3-4f16-abcd-080abdcef0ee'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:22.426078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] The token cache is being invalidate because project 307c102be16c4757889a20c68e7b6544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:22.426369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:22.426992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bef67d5f-38f3-4f16-abcd-080abdcef0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:22.428513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 987/1956] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:22 2022] DELETE /identity/v3/projects/307c102be16c4757889a20c68e7b6544 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:22.433381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b1821-b6f1-4686-b14c-acb33bc535ea None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:22.433663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b1821-b6f1-4686-b14c-acb33bc535ea None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:22.433932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b1821-b6f1-4686-b14c-acb33bc535ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:22.453181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5a6b1821-b6f1-4686-b14c-acb33bc535ea None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:22.454374 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5a6b1821-b6f1-4686-b14c-acb33bc535ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:22.511006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 970/1957] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:17:22.518728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c77e5a-52dc-4bbe-af13-e06bb504d3d7 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:22.519011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c77e5a-52dc-4bbe-af13-e06bb504d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:22.519281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c77e5a-52dc-4bbe-af13-e06bb504d3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:22.539721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-47c77e5a-52dc-4bbe-af13-e06bb504d3d7 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:22.540948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-47c77e5a-52dc-4bbe-af13-e06bb504d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:22.550116 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 988/1958] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:22.554567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b1821-b6f1-4686-b14c-acb33bc535ea None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:22.565138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b1821-b6f1-4686-b14c-acb33bc535ea None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:22.570708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a20c9a-5895-4cd1-9194-221cfc40f987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:22.571343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a20c9a-5895-4cd1-9194-221cfc40f987 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:22.571606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a20c9a-5895-4cd1-9194-221cfc40f987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:22.571884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a20c9a-5895-4cd1-9194-221cfc40f987 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:22.572567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a20c9a-5895-4cd1-9194-221cfc40f987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:17:22.572871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a20c9a-5895-4cd1-9194-221cfc40f987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:22.575063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a20c9a-5895-4cd1-9194-221cfc40f987 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:22.587139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 971/1959] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:17:22.591642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c77e5a-52dc-4bbe-af13-e06bb504d3d7 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:22.601933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c77e5a-52dc-4bbe-af13-e06bb504d3d7 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:22.607737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60031d24-9bfe-48d0-9074-c463f7d2dcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:22.608405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60031d24-9bfe-48d0-9074-c463f7d2dcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:22.608678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60031d24-9bfe-48d0-9074-c463f7d2dcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:22.608947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60031d24-9bfe-48d0-9074-c463f7d2dcf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:22.609585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60031d24-9bfe-48d0-9074-c463f7d2dcf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:22.612385 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60031d24-9bfe-48d0-9074-c463f7d2dcf4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:22.642989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 989/1960] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:17:22 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:22.647120 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a20c9a-5895-4cd1-9194-221cfc40f987 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:22.658020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a20c9a-5895-4cd1-9194-221cfc40f987 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:22.661905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:22.718286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64ec8f-74c4-46b3-a975-4fd65c2d6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:22.718986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64ec8f-74c4-46b3-a975-4fd65c2d6161 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:22.719301 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64ec8f-74c4-46b3-a975-4fd65c2d6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:22.719576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64ec8f-74c4-46b3-a975-4fd65c2d6161 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:22.720217 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64ec8f-74c4-46b3-a975-4fd65c2d6161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:22.722177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64ec8f-74c4-46b3-a975-4fd65c2d6161 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:22.745317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 972/1961] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:17:22 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:22.749342 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60031d24-9bfe-48d0-9074-c463f7d2dcf4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:22.759450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60031d24-9bfe-48d0-9074-c463f7d2dcf4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:22.764537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59043de8-fd19-4f63-a550-70002dd4c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:22.765132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59043de8-fd19-4f63-a550-70002dd4c55d admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:22.765659 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59043de8-fd19-4f63-a550-70002dd4c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:22.765934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59043de8-fd19-4f63-a550-70002dd4c55d admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:22.767269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59043de8-fd19-4f63-a550-70002dd4c55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:22.768941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59043de8-fd19-4f63-a550-70002dd4c55d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:22.779275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 990/1962] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:22.783061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64ec8f-74c4-46b3-a975-4fd65c2d6161 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:22.793525 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64ec8f-74c4-46b3-a975-4fd65c2d6161 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:22.798841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b509e0-6148-450b-95bf-eba03ba38104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:22.799447 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b509e0-6148-450b-95bf-eba03ba38104 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:22.799809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b509e0-6148-450b-95bf-eba03ba38104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:22.800080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b509e0-6148-450b-95bf-eba03ba38104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:22.801064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b509e0-6148-450b-95bf-eba03ba38104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:22.802902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b509e0-6148-450b-95bf-eba03ba38104 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:22.816412 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 973/1963] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:22.820783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59043de8-fd19-4f63-a550-70002dd4c55d admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:22.831317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59043de8-fd19-4f63-a550-70002dd4c55d admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:22.836441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f30d-b329-4df0-a84a-fa20f510a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:22.837095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f30d-b329-4df0-a84a-fa20f510a3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:22.837392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f30d-b329-4df0-a84a-fa20f510a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:22.837662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f30d-b329-4df0-a84a-fa20f510a3f0 admin admin] PATH_INFO: `/v3/projects/7e48852c49f64dae81a3c7c780f4e3ec/users/4ffd98d28ab449b09159de1ab86890b1/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:22.853494 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f30d-b329-4df0-a84a-fa20f510a3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e48852c49f64dae81a3c7c780f4e3ec, user_id=4ffd98d28ab449b09159de1ab86890b1, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:22.856223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f30d-b329-4df0-a84a-fa20f510a3f0 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:22.872283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 991/1964] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:22 2022] PUT /identity/v3/projects/7e48852c49f64dae81a3c7c780f4e3ec/users/4ffd98d28ab449b09159de1ab86890b1/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:22.882833 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44798-4ea9-49c5-b381-8632e3811fde None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:22.883357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44798-4ea9-49c5-b381-8632e3811fde None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:22.883453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44798-4ea9-49c5-b381-8632e3811fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:22.911491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b3e44798-4ea9-49c5-b381-8632e3811fde None None] MFA Rules not processed for user `4ffd98d28ab449b09159de1ab86890b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:22.913403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b3e44798-4ea9-49c5-b381-8632e3811fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:22.976808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 974/1965] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:22.981636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f30d-b329-4df0-a84a-fa20f510a3f0 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:23.004280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:23.049639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f30d-b329-4df0-a84a-fa20f510a3f0 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:23.054840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76316bb-fb4b-499d-b538-b18ba7ede166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:23.055465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76316bb-fb4b-499d-b538-b18ba7ede166 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:23.055746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76316bb-fb4b-499d-b538-b18ba7ede166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:23.056051 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76316bb-fb4b-499d-b538-b18ba7ede166 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:23.056759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76316bb-fb4b-499d-b538-b18ba7ede166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:23.058681 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76316bb-fb4b-499d-b538-b18ba7ede166 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:23.087286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 992/1966] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:17:22 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:17:23.091230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44798-4ea9-49c5-b381-8632e3811fde None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:23.102244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44798-4ea9-49c5-b381-8632e3811fde None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:23.161725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0608-74fb-4a1a-8464-2bdef1b19efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:23.162276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0608-74fb-4a1a-8464-2bdef1b19efa admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:23.162549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0608-74fb-4a1a-8464-2bdef1b19efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:23.162818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0608-74fb-4a1a-8464-2bdef1b19efa admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:23.164169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b0608-74fb-4a1a-8464-2bdef1b19efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:23.166478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b0608-74fb-4a1a-8464-2bdef1b19efa admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:23.189106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 975/1967] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:17:23 2022] POST /identity/v3/users => generated 308 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:23.193239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76316bb-fb4b-499d-b538-b18ba7ede166 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:23.203669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76316bb-fb4b-499d-b538-b18ba7ede166 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:23.208381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d92eb5-e478-4ce9-a624-c5bd202b7561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:23.208984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d92eb5-e478-4ce9-a624-c5bd202b7561 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:23.209256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d92eb5-e478-4ce9-a624-c5bd202b7561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:23.209525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d92eb5-e478-4ce9-a624-c5bd202b7561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:23.210192 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d92eb5-e478-4ce9-a624-c5bd202b7561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:23.211793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d92eb5-e478-4ce9-a624-c5bd202b7561 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:23.222501 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 993/1968] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:23.226909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0608-74fb-4a1a-8464-2bdef1b19efa admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:23.234454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:23.238745 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0608-74fb-4a1a-8464-2bdef1b19efa admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:23.245571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecad14e-d53e-4ada-afd6-a4a4d97f216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:23.246294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecad14e-d53e-4ada-afd6-a4a4d97f216c admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:23.246531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecad14e-d53e-4ada-afd6-a4a4d97f216c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:23.246805 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecad14e-d53e-4ada-afd6-a4a4d97f216c admin admin] PATH_INFO: `/v3/projects/bf4ec63aa90a4a26968bfb66a068c0d6/users/47e13b6fd36644ad9389403ef3bc8613/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:23.263389 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecad14e-d53e-4ada-afd6-a4a4d97f216c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4ec63aa90a4a26968bfb66a068c0d6, user_id=47e13b6fd36644ad9389403ef3bc8613, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:23.266139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecad14e-d53e-4ada-afd6-a4a4d97f216c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:23.282194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 976/1969] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:23 2022] PUT /identity/v3/projects/bf4ec63aa90a4a26968bfb66a068c0d6/users/47e13b6fd36644ad9389403ef3bc8613/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:23.286341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d92eb5-e478-4ce9-a624-c5bd202b7561 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:23.296634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d92eb5-e478-4ce9-a624-c5bd202b7561 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:23.354850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c885551-e33a-4a8f-967e-c7042e7b9461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:23.355677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c885551-e33a-4a8f-967e-c7042e7b9461 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:23.355818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c885551-e33a-4a8f-967e-c7042e7b9461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:23.356007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c885551-e33a-4a8f-967e-c7042e7b9461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:23.356989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c885551-e33a-4a8f-967e-c7042e7b9461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:23.358604 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c885551-e33a-4a8f-967e-c7042e7b9461 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:23.372806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 994/1970] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:17:23.374980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecad14e-d53e-4ada-afd6-a4a4d97f216c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:23.386167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecad14e-d53e-4ada-afd6-a4a4d97f216c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:23.391686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68083465-9180-4b37-8865-470a12f27941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:23.392383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68083465-9180-4b37-8865-470a12f27941 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:23.392667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68083465-9180-4b37-8865-470a12f27941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:23.392943 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68083465-9180-4b37-8865-470a12f27941 admin admin] PATH_INFO: `/v3/projects/bf4ec63aa90a4a26968bfb66a068c0d6/users/47e13b6fd36644ad9389403ef3bc8613/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:23.394880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68083465-9180-4b37-8865-470a12f27941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4ec63aa90a4a26968bfb66a068c0d6, user_id=47e13b6fd36644ad9389403ef3bc8613, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:23.397894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68083465-9180-4b37-8865-470a12f27941 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:23.409783 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 977/1971] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:23 2022] PUT /identity/v3/projects/bf4ec63aa90a4a26968bfb66a068c0d6/users/47e13b6fd36644ad9389403ef3bc8613/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:23.422092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addaec7-3e4b-4d56-80a5-3df43cc7731b None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:23.422304 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addaec7-3e4b-4d56-80a5-3df43cc7731b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:23.422597 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addaec7-3e4b-4d56-80a5-3df43cc7731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:23.454125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-6addaec7-3e4b-4d56-80a5-3df43cc7731b None None] MFA Rules not processed for user `47e13b6fd36644ad9389403ef3bc8613`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:23.455490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6addaec7-3e4b-4d56-80a5-3df43cc7731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:23.535283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 995/1972] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:23 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:23.547824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68083465-9180-4b37-8865-470a12f27941 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:23.550076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-68083465-9180-4b37-8865-470a12f27941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:23.624670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68083465-9180-4b37-8865-470a12f27941 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:23.628356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53355d0-215e-48ea-8bdf-c6e4d86b762d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:23.628980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53355d0-215e-48ea-8bdf-c6e4d86b762d service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:23.629256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53355d0-215e-48ea-8bdf-c6e4d86b762d service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:23.629579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53355d0-215e-48ea-8bdf-c6e4d86b762d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:23.639950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53355d0-215e-48ea-8bdf-c6e4d86b762d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:23.641418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53355d0-215e-48ea-8bdf-c6e4d86b762d service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:23.652173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 978/1973] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:23 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:23.794036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addaec7-3e4b-4d56-80a5-3df43cc7731b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:23.811631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:23.861002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addaec7-3e4b-4d56-80a5-3df43cc7731b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:23.866056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:23.866696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:23.866973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:23.867271 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] PATH_INFO: `/v3/users/4ffd98d28ab449b09159de1ab86890b1` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:23.868443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffd98d28ab449b09159de1ab86890b1)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:23.870474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:23.921181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffd98d28ab449b09159de1ab86890b1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:23.931833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffd98d28ab449b09159de1ab86890b1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:23.932503 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffd98d28ab449b09159de1ab86890b1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:23.944458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffd98d28ab449b09159de1ab86890b1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:23.945122 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffd98d28ab449b09159de1ab86890b1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:23.959383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 996/1974] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:23 2022] DELETE /identity/v3/users/4ffd98d28ab449b09159de1ab86890b1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:23.964052 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0135ce7-b719-4bb9-b5f8-3082f0bdf7bf None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:23.964573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0135ce7-b719-4bb9-b5f8-3082f0bdf7bf None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:23.964682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0135ce7-b719-4bb9-b5f8-3082f0bdf7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:23.984976 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d0135ce7-b719-4bb9-b5f8-3082f0bdf7bf None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:23.986212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d0135ce7-b719-4bb9-b5f8-3082f0bdf7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:24.054685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 979/1975] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:17:24.064853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:24.066509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:24.123806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b912522-0506-47a0-a85a-fa8dfe9c6537 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:24.127894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc17da8-cb82-4f7f-a3ad-b06754b2895c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:24.128551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc17da8-cb82-4f7f-a3ad-b06754b2895c service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:24.128834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc17da8-cb82-4f7f-a3ad-b06754b2895c service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:24.129106 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc17da8-cb82-4f7f-a3ad-b06754b2895c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:24.139482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc17da8-cb82-4f7f-a3ad-b06754b2895c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:24.140976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc17da8-cb82-4f7f-a3ad-b06754b2895c service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:24.150617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 997/1976] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:24.426132 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0135ce7-b719-4bb9-b5f8-3082f0bdf7bf None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:24.427665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d0135ce7-b719-4bb9-b5f8-3082f0bdf7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:24.440322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0135ce7-b719-4bb9-b5f8-3082f0bdf7bf None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:24.445554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:24.446213 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:24.446492 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:24.446763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] PATH_INFO: `/v3/projects/7e48852c49f64dae81a3c7c780f4e3ec` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:24.447916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e48852c49f64dae81a3c7c780f4e3ec)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:24.450131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:24.501476 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e48852c49f64dae81a3c7c780f4e3ec', 'request_id': 'req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:24.510702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e48852c49f64dae81a3c7c780f4e3ec', 'request_id': 'req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:24.518211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e48852c49f64dae81a3c7c780f4e3ec', 'request_id': 'req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:24.522769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:24.531687 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] The token cache is being invalidate because project 7e48852c49f64dae81a3c7c780f4e3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:24.532084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:24.533381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:24.536086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 980/1977] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:24 2022] DELETE /identity/v3/projects/7e48852c49f64dae81a3c7c780f4e3ec => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:24.539301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc17da8-cb82-4f7f-a3ad-b06754b2895c service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:24.549292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc17da8-cb82-4f7f-a3ad-b06754b2895c service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:24.585892 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:24.612324 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:24.612979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:24.613249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:24.613520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] PATH_INFO: `/v3/users/47e13b6fd36644ad9389403ef3bc8613` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:24.614669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e13b6fd36644ad9389403ef3bc8613)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:24.616655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:24.664690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e13b6fd36644ad9389403ef3bc8613'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:24.671585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e13b6fd36644ad9389403ef3bc8613'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:24.672272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e13b6fd36644ad9389403ef3bc8613'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:24.684472 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e13b6fd36644ad9389403ef3bc8613'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:24.685320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-736047d2-4ba6-4793-ae84-e87253696575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e13b6fd36644ad9389403ef3bc8613'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:24.699166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 998/1978] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:24 2022] DELETE /identity/v3/users/47e13b6fd36644ad9389403ef3bc8613 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:17:24.978830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:24.980527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:25.013260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bae3f-c21d-4220-bdd8-cb35bc02a5c1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:25.084327 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:25.085125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.085406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.085677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] PATH_INFO: `/v3/projects/bf4ec63aa90a4a26968bfb66a068c0d6` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.086823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4ec63aa90a4a26968bfb66a068c0d6)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:25.088956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:25.141569 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4ec63aa90a4a26968bfb66a068c0d6', 'request_id': 'req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:25.150756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4ec63aa90a4a26968bfb66a068c0d6', 'request_id': 'req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:25.158785 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4ec63aa90a4a26968bfb66a068c0d6', 'request_id': 'req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:25.170529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] The token cache is being invalidate because project bf4ec63aa90a4a26968bfb66a068c0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:25.170866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:25.171522 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ee31fbd9-d25d-4f91-bced-e4e1ecfedd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:25.173591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 981/1979] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:24 2022] DELETE /identity/v3/projects/bf4ec63aa90a4a26968bfb66a068c0d6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:25.178948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e26b4-8d0f-418f-8ef8-922fd169239f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.180075 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e26b4-8d0f-418f-8ef8-922fd169239f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.180401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e26b4-8d0f-418f-8ef8-922fd169239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.201399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-826e26b4-8d0f-418f-8ef8-922fd169239f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:25.202990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-826e26b4-8d0f-418f-8ef8-922fd169239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:25.297042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 999/1980] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:17:25.303272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e9a5f-97aa-4f33-b86b-2695bc2f8086 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.303541 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e9a5f-97aa-4f33-b86b-2695bc2f8086 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.303835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e9a5f-97aa-4f33-b86b-2695bc2f8086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.324498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-580e9a5f-97aa-4f33-b86b-2695bc2f8086 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:25.325841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-580e9a5f-97aa-4f33-b86b-2695bc2f8086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:25.334457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 982/1981] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:25.338565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e26b4-8d0f-418f-8ef8-922fd169239f None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:25.348786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e26b4-8d0f-418f-8ef8-922fd169239f None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:25.354166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe881d7-cedd-498c-bda2-f240984a2281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:25.354858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe881d7-cedd-498c-bda2-f240984a2281 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.355200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe881d7-cedd-498c-bda2-f240984a2281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.355533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe881d7-cedd-498c-bda2-f240984a2281 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.356700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe881d7-cedd-498c-bda2-f240984a2281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:17:25.356700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe881d7-cedd-498c-bda2-f240984a2281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:25.358464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe881d7-cedd-498c-bda2-f240984a2281 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:25.374431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1000/1982] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:17:25.378750 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e9a5f-97aa-4f33-b86b-2695bc2f8086 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:25.387964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e9a5f-97aa-4f33-b86b-2695bc2f8086 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:25.393586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377a485-7040-41d1-ae36-31d14379301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:25.394208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377a485-7040-41d1-ae36-31d14379301c admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.394481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377a485-7040-41d1-ae36-31d14379301c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.394747 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377a485-7040-41d1-ae36-31d14379301c admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.395954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377a485-7040-41d1-ae36-31d14379301c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:25.397910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377a485-7040-41d1-ae36-31d14379301c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:25.431032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 983/1983] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:17:25 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:25.435413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe881d7-cedd-498c-bda2-f240984a2281 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:25.446522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe881d7-cedd-498c-bda2-f240984a2281 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:25.494700 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:25.513768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4543d-d244-4ab4-89b8-e62abff6d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:25.514381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4543d-d244-4ab4-89b8-e62abff6d670 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.514654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4543d-d244-4ab4-89b8-e62abff6d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.514925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4543d-d244-4ab4-89b8-e62abff6d670 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.515590 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4543d-d244-4ab4-89b8-e62abff6d670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:25.517536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4543d-d244-4ab4-89b8-e62abff6d670 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:25.543882 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1001/1984] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:17:25 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:25.548171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377a485-7040-41d1-ae36-31d14379301c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:25.558740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377a485-7040-41d1-ae36-31d14379301c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:25.563590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4844-6c3e-48f4-be79-514d563adabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:25.564222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4844-6c3e-48f4-be79-514d563adabb admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.564518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4844-6c3e-48f4-be79-514d563adabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.564785 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4844-6c3e-48f4-be79-514d563adabb admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.565524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4844-6c3e-48f4-be79-514d563adabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:25.567145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4844-6c3e-48f4-be79-514d563adabb admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:25.578043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 984/1985] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:17:25.581957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4543d-d244-4ab4-89b8-e62abff6d670 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:25.592163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4543d-d244-4ab4-89b8-e62abff6d670 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:25.599872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e48da-d4df-4471-a1df-9cb3ebd8b7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:25.600714 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e48da-d4df-4471-a1df-9cb3ebd8b7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.601219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e48da-d4df-4471-a1df-9cb3ebd8b7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.601559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e48da-d4df-4471-a1df-9cb3ebd8b7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.602447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e48da-d4df-4471-a1df-9cb3ebd8b7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:25.604285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e48da-d4df-4471-a1df-9cb3ebd8b7bf admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:25.616916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1002/1986] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:17:25.622898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4844-6c3e-48f4-be79-514d563adabb admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:25.634747 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4844-6c3e-48f4-be79-514d563adabb admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:25.639628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51feec04-8acd-46d7-8cbd-462b9cf0aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:25.640320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51feec04-8acd-46d7-8cbd-462b9cf0aeff admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.640600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51feec04-8acd-46d7-8cbd-462b9cf0aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.640874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51feec04-8acd-46d7-8cbd-462b9cf0aeff admin admin] PATH_INFO: `/v3/projects/b581dbe3d3b7430284d9c5fcb2fe24a5/users/febf2832fa8547b8a6400b021840280e/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.656819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51feec04-8acd-46d7-8cbd-462b9cf0aeff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b581dbe3d3b7430284d9c5fcb2fe24a5, user_id=febf2832fa8547b8a6400b021840280e, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:25.659655 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51feec04-8acd-46d7-8cbd-462b9cf0aeff admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:25.675719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 985/1987] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:25 2022] PUT /identity/v3/projects/b581dbe3d3b7430284d9c5fcb2fe24a5/users/febf2832fa8547b8a6400b021840280e/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:25.687613 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b103aa-e0da-4231-b81f-48fedc5e7439 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.688000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b103aa-e0da-4231-b81f-48fedc5e7439 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.688365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b103aa-e0da-4231-b81f-48fedc5e7439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.727016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-70b103aa-e0da-4231-b81f-48fedc5e7439 None None] MFA Rules not processed for user `febf2832fa8547b8a6400b021840280e`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:25.728328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-70b103aa-e0da-4231-b81f-48fedc5e7439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:25.804265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1003/1988] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:25.809012 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51feec04-8acd-46d7-8cbd-462b9cf0aeff admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:25.831839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:25.884480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51feec04-8acd-46d7-8cbd-462b9cf0aeff admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:25.889225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65bca0-0ff8-45e7-9c83-d56ff1fd12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:25.889835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65bca0-0ff8-45e7-9c83-d56ff1fd12a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:25.890106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65bca0-0ff8-45e7-9c83-d56ff1fd12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:25.890381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65bca0-0ff8-45e7-9c83-d56ff1fd12a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:25.891028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65bca0-0ff8-45e7-9c83-d56ff1fd12a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:25.893018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65bca0-0ff8-45e7-9c83-d56ff1fd12a5 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:25.920791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 986/1989] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:17:25 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:25.924846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b103aa-e0da-4231-b81f-48fedc5e7439 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:25.936039 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b103aa-e0da-4231-b81f-48fedc5e7439 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:25.999330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbb47d-5cc1-4078-841f-41f7837b768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:25.999955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbb47d-5cc1-4078-841f-41f7837b768c admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:26.000233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbb47d-5cc1-4078-841f-41f7837b768c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:26.000564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbb47d-5cc1-4078-841f-41f7837b768c admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:26.001217 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbb47d-5cc1-4078-841f-41f7837b768c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:26.004233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbb47d-5cc1-4078-841f-41f7837b768c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:26.028322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1004/1990] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:17:25 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:17:26.031511 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65bca0-0ff8-45e7-9c83-d56ff1fd12a5 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:26.042358 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65bca0-0ff8-45e7-9c83-d56ff1fd12a5 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:26.047410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf852316-afb8-41e4-91af-d937c920562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:26.048115 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf852316-afb8-41e4-91af-d937c920562f admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:26.048548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf852316-afb8-41e4-91af-d937c920562f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:26.048866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf852316-afb8-41e4-91af-d937c920562f admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:26.049596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf852316-afb8-41e4-91af-d937c920562f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:26.051366 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf852316-afb8-41e4-91af-d937c920562f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:26.062601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 987/1991] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:26.066990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbb47d-5cc1-4078-841f-41f7837b768c admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:26.080163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbb47d-5cc1-4078-841f-41f7837b768c admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:26.085869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b478d-9627-4a6b-9f9b-f9ba93fd1c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:26.086556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b478d-9627-4a6b-9f9b-f9ba93fd1c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:26.086849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b478d-9627-4a6b-9f9b-f9ba93fd1c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:26.087115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b478d-9627-4a6b-9f9b-f9ba93fd1c34 admin admin] PATH_INFO: `/v3/projects/247ecd347ee640fd9580c445eaf759d8/users/e2b65ed55a5a4afa8285581f11c72bcf/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:26.102482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b478d-9627-4a6b-9f9b-f9ba93fd1c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247ecd347ee640fd9580c445eaf759d8, user_id=e2b65ed55a5a4afa8285581f11c72bcf, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:26.105251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b478d-9627-4a6b-9f9b-f9ba93fd1c34 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:26.119643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1005/1992] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:26 2022] PUT /identity/v3/projects/247ecd347ee640fd9580c445eaf759d8/users/e2b65ed55a5a4afa8285581f11c72bcf/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:26.123804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf852316-afb8-41e4-91af-d937c920562f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:26.134467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf852316-afb8-41e4-91af-d937c920562f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:26.192957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3a012-df45-4414-a071-ef2f38b4555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:26.193573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a012-df45-4414-a071-ef2f38b4555f admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:26.193850 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a012-df45-4414-a071-ef2f38b4555f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:26.194117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a012-df45-4414-a071-ef2f38b4555f admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:26.194755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3a012-df45-4414-a071-ef2f38b4555f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:26.196374 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3a012-df45-4414-a071-ef2f38b4555f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:26.206440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 988/1993] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:26.210909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b478d-9627-4a6b-9f9b-f9ba93fd1c34 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:26.221363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b478d-9627-4a6b-9f9b-f9ba93fd1c34 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:26.226086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089bac1-8b11-48c7-bedd-5d28e61345a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:26.226733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089bac1-8b11-48c7-bedd-5d28e61345a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:26.227006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089bac1-8b11-48c7-bedd-5d28e61345a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:26.227274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089bac1-8b11-48c7-bedd-5d28e61345a2 admin admin] PATH_INFO: `/v3/projects/247ecd347ee640fd9580c445eaf759d8/users/e2b65ed55a5a4afa8285581f11c72bcf/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:26.229242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089bac1-8b11-48c7-bedd-5d28e61345a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247ecd347ee640fd9580c445eaf759d8, user_id=e2b65ed55a5a4afa8285581f11c72bcf, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:26.231885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089bac1-8b11-48c7-bedd-5d28e61345a2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:26.242357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1006/1994] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:26 2022] PUT /identity/v3/projects/247ecd347ee640fd9580c445eaf759d8/users/e2b65ed55a5a4afa8285581f11c72bcf/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:17:26.252982 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287454-9244-4b42-b799-89b5b512f93d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:26.253271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287454-9244-4b42-b799-89b5b512f93d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:26.253545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287454-9244-4b42-b799-89b5b512f93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:26.283944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-92287454-9244-4b42-b799-89b5b512f93d None None] MFA Rules not processed for user `e2b65ed55a5a4afa8285581f11c72bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:26.285196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-92287454-9244-4b42-b799-89b5b512f93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:26.355103 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 989/1995] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:26.366862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089bac1-8b11-48c7-bedd-5d28e61345a2 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:26.368738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1089bac1-8b11-48c7-bedd-5d28e61345a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:26.375260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:26.435074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089bac1-8b11-48c7-bedd-5d28e61345a2 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:26.439048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ce74d-4e5f-4c50-9e75-8ab892a9f0bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:26.439759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ce74d-4e5f-4c50-9e75-8ab892a9f0bb service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:26.440103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ce74d-4e5f-4c50-9e75-8ab892a9f0bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:26.440478 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ce74d-4e5f-4c50-9e75-8ab892a9f0bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:26.449802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ce74d-4e5f-4c50-9e75-8ab892a9f0bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:26.451550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ce74d-4e5f-4c50-9e75-8ab892a9f0bb service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:26.461812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1007/1996] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:26.899664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287454-9244-4b42-b799-89b5b512f93d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:26.918259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:26.964060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287454-9244-4b42-b799-89b5b512f93d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:26.968770 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:26.969417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:26.969693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:26.969965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] PATH_INFO: `/v3/users/febf2832fa8547b8a6400b021840280e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:26.971086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=febf2832fa8547b8a6400b021840280e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:26.973108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:27.022015 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febf2832fa8547b8a6400b021840280e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.030546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febf2832fa8547b8a6400b021840280e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.046976 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febf2832fa8547b8a6400b021840280e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.047973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febf2832fa8547b8a6400b021840280e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.048626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febf2832fa8547b8a6400b021840280e'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.062855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 990/1997] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:26 2022] DELETE /identity/v3/users/febf2832fa8547b8a6400b021840280e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:17:27.067403 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963a8db-f628-4d0d-9eaa-ddfff51a9654 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:27.067906 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963a8db-f628-4d0d-9eaa-ddfff51a9654 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:27.068022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963a8db-f628-4d0d-9eaa-ddfff51a9654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:27.087022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c963a8db-f628-4d0d-9eaa-ddfff51a9654 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:27.088393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c963a8db-f628-4d0d-9eaa-ddfff51a9654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:27.148252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1008/1998] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:27.158413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:27.159879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:27.220792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d5850-e020-41c3-8a0e-a39608800af8 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:27.224834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e74d1-5b90-4eae-868c-793b14670df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:27.225445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e74d1-5b90-4eae-868c-793b14670df6 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:27.225722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e74d1-5b90-4eae-868c-793b14670df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:27.225987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e74d1-5b90-4eae-868c-793b14670df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:27.235455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e74d1-5b90-4eae-868c-793b14670df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:27.237257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e74d1-5b90-4eae-868c-793b14670df6 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:27.247492 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 991/1999] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:27.549862 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963a8db-f628-4d0d-9eaa-ddfff51a9654 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:27.551458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c963a8db-f628-4d0d-9eaa-ddfff51a9654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:27.564832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963a8db-f628-4d0d-9eaa-ddfff51a9654 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:27.571721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:27.572610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:27.573029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:27.573439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] PATH_INFO: `/v3/projects/b581dbe3d3b7430284d9c5fcb2fe24a5` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:27.574709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b581dbe3d3b7430284d9c5fcb2fe24a5)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:27.577738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:27.639762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b581dbe3d3b7430284d9c5fcb2fe24a5', 'request_id': 'req-e0111791-bef1-4d1b-baa9-fafebd429913'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.646934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b581dbe3d3b7430284d9c5fcb2fe24a5', 'request_id': 'req-e0111791-bef1-4d1b-baa9-fafebd429913'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.653494 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b581dbe3d3b7430284d9c5fcb2fe24a5', 'request_id': 'req-e0111791-bef1-4d1b-baa9-fafebd429913'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.667840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] The token cache is being invalidate because project b581dbe3d3b7430284d9c5fcb2fe24a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:27.668274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.669708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.673454 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1009/2000] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:27 2022] DELETE /identity/v3/projects/b581dbe3d3b7430284d9c5fcb2fe24a5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:27.678098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e74d1-5b90-4eae-868c-793b14670df6 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:27.689033 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e74d1-5b90-4eae-868c-793b14670df6 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:27.726196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:27.755771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:27.756545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:27.756883 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:27.757218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] PATH_INFO: `/v3/users/e2b65ed55a5a4afa8285581f11c72bcf` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:27.758693 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b65ed55a5a4afa8285581f11c72bcf)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:27.760759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:27.819518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b65ed55a5a4afa8285581f11c72bcf'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.828317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b65ed55a5a4afa8285581f11c72bcf'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.849001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b65ed55a5a4afa8285581f11c72bcf'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.849793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b65ed55a5a4afa8285581f11c72bcf'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.853923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ce2e7de4-3b62-43e8-9b57-f7aed0ef6dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b65ed55a5a4afa8285581f11c72bcf'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:27.873087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 992/2001] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:27 2022] DELETE /identity/v3/users/e2b65ed55a5a4afa8285581f11c72bcf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:28.219021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:28.220640 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:28.234376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111791-bef1-4d1b-baa9-fafebd429913 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:28.264239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:28.296722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:28.296722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:28.297006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:28.297119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] PATH_INFO: `/v3/projects/247ecd347ee640fd9580c445eaf759d8` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:28.298279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247ecd347ee640fd9580c445eaf759d8)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:28.300196 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:28.348424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247ecd347ee640fd9580c445eaf759d8', 'request_id': 'req-32f9404c-061a-4a96-a7af-9df3c8e62261'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:28.354221 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247ecd347ee640fd9580c445eaf759d8', 'request_id': 'req-32f9404c-061a-4a96-a7af-9df3c8e62261'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:28.360717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247ecd347ee640fd9580c445eaf759d8', 'request_id': 'req-32f9404c-061a-4a96-a7af-9df3c8e62261'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:28.374823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] The token cache is being invalidate because project 247ecd347ee640fd9580c445eaf759d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:28.375120 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:28.375804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-32f9404c-061a-4a96-a7af-9df3c8e62261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:28.377376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1010/2002] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:28 2022] DELETE /identity/v3/projects/247ecd347ee640fd9580c445eaf759d8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:28.382440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1e320-ba6c-4b69-8660-316f7fa289e5 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:28.382951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1e320-ba6c-4b69-8660-316f7fa289e5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:28.383059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1e320-ba6c-4b69-8660-316f7fa289e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:28.404056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-37a1e320-ba6c-4b69-8660-316f7fa289e5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:28.405339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-37a1e320-ba6c-4b69-8660-316f7fa289e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:28.464937 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 993/2003] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:28.473021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3a297-48a4-417a-a51f-b47fc25baeaf None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:28.473406 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3a297-48a4-417a-a51f-b47fc25baeaf None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:28.473742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3a297-48a4-417a-a51f-b47fc25baeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:28.494535 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a7a3a297-48a4-417a-a51f-b47fc25baeaf None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:28.495822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a7a3a297-48a4-417a-a51f-b47fc25baeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:28.503800 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1011/2004] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:28.508108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1e320-ba6c-4b69-8660-316f7fa289e5 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:28.518337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1e320-ba6c-4b69-8660-316f7fa289e5 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:28.523648 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57005b8e-df06-4bb7-af0c-362ee3dd3a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:28.524266 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005b8e-df06-4bb7-af0c-362ee3dd3a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:28.524589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005b8e-df06-4bb7-af0c-362ee3dd3a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:28.524857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005b8e-df06-4bb7-af0c-362ee3dd3a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:28.525508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57005b8e-df06-4bb7-af0c-362ee3dd3a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:17:28.525807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57005b8e-df06-4bb7-af0c-362ee3dd3a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:28.527406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57005b8e-df06-4bb7-af0c-362ee3dd3a71 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:28.540267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 994/2005] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:17:28.544790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3a297-48a4-417a-a51f-b47fc25baeaf None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:28.554438 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3a297-48a4-417a-a51f-b47fc25baeaf None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:28.559837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0033-a1f8-4905-a56e-56ba5f4fc3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:28.560421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0033-a1f8-4905-a56e-56ba5f4fc3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:28.560806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0033-a1f8-4905-a56e-56ba5f4fc3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:28.560971 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0033-a1f8-4905-a56e-56ba5f4fc3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:28.561686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c0033-a1f8-4905-a56e-56ba5f4fc3e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:28.563630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c0033-a1f8-4905-a56e-56ba5f4fc3e9 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:28.593876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1012/2006] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:17:28 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:17:28.598317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57005b8e-df06-4bb7-af0c-362ee3dd3a71 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:28.609411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57005b8e-df06-4bb7-af0c-362ee3dd3a71 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:28.652695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:28.669930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aed53-3a80-4174-b578-c16543b9acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:28.670455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aed53-3a80-4174-b578-c16543b9acca admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:28.670732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aed53-3a80-4174-b578-c16543b9acca admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:28.670999 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aed53-3a80-4174-b578-c16543b9acca admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:28.671636 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6aed53-3a80-4174-b578-c16543b9acca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:28.673586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6aed53-3a80-4174-b578-c16543b9acca admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:28.696736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 995/2007] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:17:28 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:17:28.700905 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0033-a1f8-4905-a56e-56ba5f4fc3e9 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:28.712150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0033-a1f8-4905-a56e-56ba5f4fc3e9 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:28.717265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68ce36-16fe-4f39-a1ba-7acca2f6780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:28.717868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68ce36-16fe-4f39-a1ba-7acca2f6780a admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:28.718145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68ce36-16fe-4f39-a1ba-7acca2f6780a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:28.718412 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68ce36-16fe-4f39-a1ba-7acca2f6780a admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:28.719054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68ce36-16fe-4f39-a1ba-7acca2f6780a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:28.720793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68ce36-16fe-4f39-a1ba-7acca2f6780a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:28.731163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1013/2008] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:28.735310 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aed53-3a80-4174-b578-c16543b9acca admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:28.746824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aed53-3a80-4174-b578-c16543b9acca admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:28.752144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79277b-8522-4e7f-9a02-96d8051960b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:28.752796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79277b-8522-4e7f-9a02-96d8051960b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:28.753080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79277b-8522-4e7f-9a02-96d8051960b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:28.753353 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79277b-8522-4e7f-9a02-96d8051960b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:28.754007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79277b-8522-4e7f-9a02-96d8051960b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:28.755620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79277b-8522-4e7f-9a02-96d8051960b3 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:28.766923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 996/2009] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:28.771386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68ce36-16fe-4f39-a1ba-7acca2f6780a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:28.781636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68ce36-16fe-4f39-a1ba-7acca2f6780a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:28.786639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134baf73-0ced-4823-9402-d440488f5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:28.787551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134baf73-0ced-4823-9402-d440488f5d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:28.787919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134baf73-0ced-4823-9402-d440488f5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:28.788399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134baf73-0ced-4823-9402-d440488f5d0e admin admin] PATH_INFO: `/v3/projects/28a67ac848e54880a8d08ef88f6049e7/users/37d8279be34d4272a45b4bfb9c65ba7b/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:28.804513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134baf73-0ced-4823-9402-d440488f5d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a67ac848e54880a8d08ef88f6049e7, user_id=37d8279be34d4272a45b4bfb9c65ba7b, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:28.807182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134baf73-0ced-4823-9402-d440488f5d0e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:28.821008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1014/2010] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:28 2022] PUT /identity/v3/projects/28a67ac848e54880a8d08ef88f6049e7/users/37d8279be34d4272a45b4bfb9c65ba7b/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:28.832384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fca1-2da1-4d86-95ed-062de2c333e9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:28.832678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fca1-2da1-4d86-95ed-062de2c333e9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:28.832961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fca1-2da1-4d86-95ed-062de2c333e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:28.862756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b852fca1-2da1-4d86-95ed-062de2c333e9 None None] MFA Rules not processed for user `37d8279be34d4272a45b4bfb9c65ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:28.863987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b852fca1-2da1-4d86-95ed-062de2c333e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:28.928728 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 997/2011] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:28.933595 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134baf73-0ced-4823-9402-d440488f5d0e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:28.993738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:28.997516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134baf73-0ced-4823-9402-d440488f5d0e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:29.004823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b6220-17bd-4e9c-ae96-73dc233d0cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:29.005734 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b6220-17bd-4e9c-ae96-73dc233d0cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:29.006169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b6220-17bd-4e9c-ae96-73dc233d0cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:29.006570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b6220-17bd-4e9c-ae96-73dc233d0cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:29.007343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b6220-17bd-4e9c-ae96-73dc233d0cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:29.009588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b6220-17bd-4e9c-ae96-73dc233d0cb4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:29.039310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1015/2012] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:17:28 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:29.043618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852fca1-2da1-4d86-95ed-062de2c333e9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:29.054671 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852fca1-2da1-4d86-95ed-062de2c333e9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:29.113704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3ae0-97d5-4db4-bdb4-950cfc36a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:29.114315 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3ae0-97d5-4db4-bdb4-950cfc36a276 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:29.114705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3ae0-97d5-4db4-bdb4-950cfc36a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:29.114974 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3ae0-97d5-4db4-bdb4-950cfc36a276 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:29.115600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e3ae0-97d5-4db4-bdb4-950cfc36a276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:29.117593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e3ae0-97d5-4db4-bdb4-950cfc36a276 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:29.140878 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 998/2013] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:17:29 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:29.144888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b6220-17bd-4e9c-ae96-73dc233d0cb4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:29.154933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b6220-17bd-4e9c-ae96-73dc233d0cb4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:29.159803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01461f64-6fed-4207-96f5-721d0964f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:29.160436 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461f64-6fed-4207-96f5-721d0964f22a admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:29.160711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461f64-6fed-4207-96f5-721d0964f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:29.160981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461f64-6fed-4207-96f5-721d0964f22a admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:29.161643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01461f64-6fed-4207-96f5-721d0964f22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:29.163223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01461f64-6fed-4207-96f5-721d0964f22a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:29.173942 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1016/2014] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:29.178072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3ae0-97d5-4db4-bdb4-950cfc36a276 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:29.188337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3ae0-97d5-4db4-bdb4-950cfc36a276 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:29.194802 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f136e6-514d-4f19-b3d3-9177ffa87d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:29.195448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f136e6-514d-4f19-b3d3-9177ffa87d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:29.195720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f136e6-514d-4f19-b3d3-9177ffa87d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:29.195985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f136e6-514d-4f19-b3d3-9177ffa87d2c admin admin] PATH_INFO: `/v3/projects/ef5826aa087f4d45aa8277a1ce7e6da9/users/f74048a05e244035bdc449334b3e9d75/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:29.211487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f136e6-514d-4f19-b3d3-9177ffa87d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5826aa087f4d45aa8277a1ce7e6da9, user_id=f74048a05e244035bdc449334b3e9d75, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:29.214188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f136e6-514d-4f19-b3d3-9177ffa87d2c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:29.228962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 999/2015] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:29 2022] PUT /identity/v3/projects/ef5826aa087f4d45aa8277a1ce7e6da9/users/f74048a05e244035bdc449334b3e9d75/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:29.233046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01461f64-6fed-4207-96f5-721d0964f22a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:29.243095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01461f64-6fed-4207-96f5-721d0964f22a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:29.299953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5e4f6-fc1d-428c-ae8c-951726dfb52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:29.300599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e4f6-fc1d-428c-ae8c-951726dfb52f admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:29.300875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e4f6-fc1d-428c-ae8c-951726dfb52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:29.301141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e4f6-fc1d-428c-ae8c-951726dfb52f admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:29.301776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5e4f6-fc1d-428c-ae8c-951726dfb52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:29.303378 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5e4f6-fc1d-428c-ae8c-951726dfb52f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:29.313266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1017/2016] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:17:29.317675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f136e6-514d-4f19-b3d3-9177ffa87d2c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:29.328385 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f136e6-514d-4f19-b3d3-9177ffa87d2c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:29.333769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2978256-5373-43f6-92eb-a0ad0e16f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:29.334421 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2978256-5373-43f6-92eb-a0ad0e16f0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:29.334702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2978256-5373-43f6-92eb-a0ad0e16f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:29.334974 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2978256-5373-43f6-92eb-a0ad0e16f0c1 admin admin] PATH_INFO: `/v3/projects/ef5826aa087f4d45aa8277a1ce7e6da9/users/f74048a05e244035bdc449334b3e9d75/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:29.337018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2978256-5373-43f6-92eb-a0ad0e16f0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5826aa087f4d45aa8277a1ce7e6da9, user_id=f74048a05e244035bdc449334b3e9d75, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:29.339667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2978256-5373-43f6-92eb-a0ad0e16f0c1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:29.350565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1000/2017] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:29 2022] PUT /identity/v3/projects/ef5826aa087f4d45aa8277a1ce7e6da9/users/f74048a05e244035bdc449334b3e9d75/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:29.360846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1748e-d7ef-42cb-9a84-5595c5c991dc None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:29.361128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1748e-d7ef-42cb-9a84-5595c5c991dc None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:29.361400 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1748e-d7ef-42cb-9a84-5595c5c991dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:29.389873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c0a1748e-d7ef-42cb-9a84-5595c5c991dc None None] MFA Rules not processed for user `f74048a05e244035bdc449334b3e9d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:29.391073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c0a1748e-d7ef-42cb-9a84-5595c5c991dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:29.459101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1018/2018] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:17:29.471125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2978256-5373-43f6-92eb-a0ad0e16f0c1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:29.473060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b2978256-5373-43f6-92eb-a0ad0e16f0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:29.479862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:29.531961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2978256-5373-43f6-92eb-a0ad0e16f0c1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:29.536268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a551aa5-2056-4f91-a9d6-2f67f1b46818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:29.536909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a551aa5-2056-4f91-a9d6-2f67f1b46818 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:29.537187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a551aa5-2056-4f91-a9d6-2f67f1b46818 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:29.537454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a551aa5-2056-4f91-a9d6-2f67f1b46818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:29.547580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a551aa5-2056-4f91-a9d6-2f67f1b46818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:29.549047 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a551aa5-2056-4f91-a9d6-2f67f1b46818 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:29.558474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1001/2019] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:29.635807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1748e-d7ef-42cb-9a84-5595c5c991dc None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:29.646171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1748e-d7ef-42cb-9a84-5595c5c991dc None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:29.650736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b5c13-1ce6-42cc-863e-b47fa96be045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:29.651337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b5c13-1ce6-42cc-863e-b47fa96be045 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:29.651614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b5c13-1ce6-42cc-863e-b47fa96be045 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:29.651878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b5c13-1ce6-42cc-863e-b47fa96be045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:29.712144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:29.723469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b5c13-1ce6-42cc-863e-b47fa96be045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:29.724946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b5c13-1ce6-42cc-863e-b47fa96be045 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:29.733990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1019/2020] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:30.007443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a551aa5-2056-4f91-a9d6-2f67f1b46818 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:30.070228 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a551aa5-2056-4f91-a9d6-2f67f1b46818 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:30.075039 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:30.075685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:30.075961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:30.076233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] PATH_INFO: `/v3/users/37d8279be34d4272a45b4bfb9c65ba7b` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:30.077415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d8279be34d4272a45b4bfb9c65ba7b)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:30.079379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:30.132907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d8279be34d4272a45b4bfb9c65ba7b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.143248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d8279be34d4272a45b4bfb9c65ba7b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.160230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d8279be34d4272a45b4bfb9c65ba7b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.161046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d8279be34d4272a45b4bfb9c65ba7b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.161789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d8279be34d4272a45b4bfb9c65ba7b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.179093 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1002/2021] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:30 2022] DELETE /identity/v3/users/37d8279be34d4272a45b4bfb9c65ba7b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:30.184114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6350e1-3336-4acb-907d-2bb677569033 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:30.184622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6350e1-3336-4acb-907d-2bb677569033 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:30.185077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6350e1-3336-4acb-907d-2bb677569033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:30.205002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-bd6350e1-3336-4acb-907d-2bb677569033 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:30.206218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bd6350e1-3336-4acb-907d-2bb677569033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:30.271272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1020/2022] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:17:30.282343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:30.283860 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:30.315697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:30.345149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf465ec-e8b7-4317-81d0-5c784624ed82 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:30.349657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762b81e-5485-4cd4-a916-609a59d860b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:30.350266 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762b81e-5485-4cd4-a916-609a59d860b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:30.350538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762b81e-5485-4cd4-a916-609a59d860b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:30.350801 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762b81e-5485-4cd4-a916-609a59d860b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:30.360814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762b81e-5485-4cd4-a916-609a59d860b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:30.362578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762b81e-5485-4cd4-a916-609a59d860b4 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:30.372185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1003/2023] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:30.645823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6350e1-3336-4acb-907d-2bb677569033 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:30.647309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bd6350e1-3336-4acb-907d-2bb677569033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:30.659545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6350e1-3336-4acb-907d-2bb677569033 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:30.664560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:30.665237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:30.665510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:30.665744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] PATH_INFO: `/v3/projects/28a67ac848e54880a8d08ef88f6049e7` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:30.667035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a67ac848e54880a8d08ef88f6049e7)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:30.668961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:30.721545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a67ac848e54880a8d08ef88f6049e7', 'request_id': 'req-09bcac21-0df4-456b-b8df-d92d5d4c35ac'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.727399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a67ac848e54880a8d08ef88f6049e7', 'request_id': 'req-09bcac21-0df4-456b-b8df-d92d5d4c35ac'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.733616 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a67ac848e54880a8d08ef88f6049e7', 'request_id': 'req-09bcac21-0df4-456b-b8df-d92d5d4c35ac'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.748993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] The token cache is being invalidate because project 28a67ac848e54880a8d08ef88f6049e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:30.749271 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.749916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.751469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1021/2024] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:30 2022] DELETE /identity/v3/projects/28a67ac848e54880a8d08ef88f6049e7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:30.755566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762b81e-5485-4cd4-a916-609a59d860b4 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:30.765534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762b81e-5485-4cd4-a916-609a59d860b4 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:30.823860 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:30.824449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:30.824737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:30.825011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] PATH_INFO: `/v3/users/f74048a05e244035bdc449334b3e9d75` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:30.826154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74048a05e244035bdc449334b3e9d75)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:30.828129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:30.876867 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74048a05e244035bdc449334b3e9d75'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.883846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74048a05e244035bdc449334b3e9d75'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.896268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74048a05e244035bdc449334b3e9d75'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.896981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74048a05e244035bdc449334b3e9d75'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.897599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-3f4c9962-5799-475f-94d6-32ff90195b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74048a05e244035bdc449334b3e9d75'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:30.912714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1004/2025] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:30 2022] DELETE /identity/v3/users/f74048a05e244035bdc449334b3e9d75 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:31.203779 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:31.205268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:31.219782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcac21-0df4-456b-b8df-d92d5d4c35ac admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:31.279828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:31.280519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:31.280781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:31.281049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] PATH_INFO: `/v3/projects/ef5826aa087f4d45aa8277a1ce7e6da9` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:31.282360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5826aa087f4d45aa8277a1ce7e6da9)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:31.284272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:31.301272 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:31.333694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5826aa087f4d45aa8277a1ce7e6da9', 'request_id': 'req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:31.339285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5826aa087f4d45aa8277a1ce7e6da9', 'request_id': 'req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:31.345832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5826aa087f4d45aa8277a1ce7e6da9', 'request_id': 'req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:31.360192 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] The token cache is being invalidate because project ef5826aa087f4d45aa8277a1ce7e6da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:31.360507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:31.361108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9da71ed1-2f31-4f24-b0ab-fb9632ba367f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:31.362912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1022/2026] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:31 2022] DELETE /identity/v3/projects/ef5826aa087f4d45aa8277a1ce7e6da9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:31.368681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04d80-0a77-41e5-b322-ceae01f63ca7 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:31.368991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04d80-0a77-41e5-b322-ceae01f63ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:31.369295 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04d80-0a77-41e5-b322-ceae01f63ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:31.389177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3ae04d80-0a77-41e5-b322-ceae01f63ca7 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:31.390455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3ae04d80-0a77-41e5-b322-ceae01f63ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:31.438424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:31.455909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1005/2027] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:31.467641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2f099-e9f1-4885-ba1c-cfd2637710a8 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:31.468077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2f099-e9f1-4885-ba1c-cfd2637710a8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:31.468410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2f099-e9f1-4885-ba1c-cfd2637710a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:31.489755 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-cdd2f099-e9f1-4885-ba1c-cfd2637710a8 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:31.491078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cdd2f099-e9f1-4885-ba1c-cfd2637710a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:31.500193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1023/2028] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:17:31.504582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04d80-0a77-41e5-b322-ceae01f63ca7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:31.514972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04d80-0a77-41e5-b322-ceae01f63ca7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:31.522765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2640e3a-f347-417c-a4a2-fbef55cc2bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:31.523605 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2640e3a-f347-417c-a4a2-fbef55cc2bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:31.524016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2640e3a-f347-417c-a4a2-fbef55cc2bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:31.524367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2640e3a-f347-417c-a4a2-fbef55cc2bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:31.525313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2640e3a-f347-417c-a4a2-fbef55cc2bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:17:31.525724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2640e3a-f347-417c-a4a2-fbef55cc2bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:31.528262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2640e3a-f347-417c-a4a2-fbef55cc2bbf admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:31.540455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1006/2029] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:17:31.544936 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2f099-e9f1-4885-ba1c-cfd2637710a8 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:31.554413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2f099-e9f1-4885-ba1c-cfd2637710a8 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:31.560424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c214674-6665-48d3-8284-be5786fa1ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:31.561036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c214674-6665-48d3-8284-be5786fa1ced admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:31.561317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c214674-6665-48d3-8284-be5786fa1ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:31.561581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c214674-6665-48d3-8284-be5786fa1ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:31.562217 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c214674-6665-48d3-8284-be5786fa1ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:31.564148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c214674-6665-48d3-8284-be5786fa1ced admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:31.593354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1024/2030] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:17:31 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:31.597458 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2640e3a-f347-417c-a4a2-fbef55cc2bbf admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:31.609093 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2640e3a-f347-417c-a4a2-fbef55cc2bbf admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:31.668611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8a383-b775-4794-bad1-1a63c72ba17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:31.669217 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8a383-b775-4794-bad1-1a63c72ba17b admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:31.669508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8a383-b775-4794-bad1-1a63c72ba17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:31.669773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8a383-b775-4794-bad1-1a63c72ba17b admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:31.670404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8a383-b775-4794-bad1-1a63c72ba17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:31.672322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8a383-b775-4794-bad1-1a63c72ba17b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:31.695281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1007/2031] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:17:31 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:31.699957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c214674-6665-48d3-8284-be5786fa1ced admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:31.711293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c214674-6665-48d3-8284-be5786fa1ced admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:31.716795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ee393-a4b6-4fd4-bb91-255bb93777f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:31.717395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ee393-a4b6-4fd4-bb91-255bb93777f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:31.717670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ee393-a4b6-4fd4-bb91-255bb93777f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:31.717936 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ee393-a4b6-4fd4-bb91-255bb93777f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:31.718565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ee393-a4b6-4fd4-bb91-255bb93777f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:31.720205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ee393-a4b6-4fd4-bb91-255bb93777f7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:31.730246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1025/2032] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:31.734333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8a383-b775-4794-bad1-1a63c72ba17b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:31.745120 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8a383-b775-4794-bad1-1a63c72ba17b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:31.750911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cac42b-f51b-412d-9629-6e80cf1ef1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:31.751510 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac42b-f51b-412d-9629-6e80cf1ef1bd admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:31.751784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac42b-f51b-412d-9629-6e80cf1ef1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:31.752052 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac42b-f51b-412d-9629-6e80cf1ef1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:31.752722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cac42b-f51b-412d-9629-6e80cf1ef1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:31.754352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cac42b-f51b-412d-9629-6e80cf1ef1bd admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:31.766370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1008/2033] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:31.770575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ee393-a4b6-4fd4-bb91-255bb93777f7 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:31.780716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ee393-a4b6-4fd4-bb91-255bb93777f7 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:31.785781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abadaf-ef75-4cfb-be90-522511d153e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:31.786466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abadaf-ef75-4cfb-be90-522511d153e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:31.786770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abadaf-ef75-4cfb-be90-522511d153e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:31.787036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abadaf-ef75-4cfb-be90-522511d153e2 admin admin] PATH_INFO: `/v3/projects/5f1e694d96bc480da01b8b64ea98e242/users/256d5952eef1431994c21b51ccdb77f7/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:31.801589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abadaf-ef75-4cfb-be90-522511d153e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1e694d96bc480da01b8b64ea98e242, user_id=256d5952eef1431994c21b51ccdb77f7, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:31.804250 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abadaf-ef75-4cfb-be90-522511d153e2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:31.818614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1026/2034] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:31 2022] PUT /identity/v3/projects/5f1e694d96bc480da01b8b64ea98e242/users/256d5952eef1431994c21b51ccdb77f7/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:31.830236 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baf0e2-19f3-4d78-a92b-983ce63fa5e2 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:31.830536 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baf0e2-19f3-4d78-a92b-983ce63fa5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:31.830784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baf0e2-19f3-4d78-a92b-983ce63fa5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:31.860086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a1baf0e2-19f3-4d78-a92b-983ce63fa5e2 None None] MFA Rules not processed for user `256d5952eef1431994c21b51ccdb77f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:31.862049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a1baf0e2-19f3-4d78-a92b-983ce63fa5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:31.936502 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1009/2035] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:31.951303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abadaf-ef75-4cfb-be90-522511d153e2 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:31.953408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-22abadaf-ef75-4cfb-be90-522511d153e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:32.012225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abadaf-ef75-4cfb-be90-522511d153e2 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:32.016676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb867324-7622-45b2-bb6d-8bd9e31b1547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:32.017290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb867324-7622-45b2-bb6d-8bd9e31b1547 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:32.017594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb867324-7622-45b2-bb6d-8bd9e31b1547 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:32.017867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb867324-7622-45b2-bb6d-8bd9e31b1547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:32.026745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb867324-7622-45b2-bb6d-8bd9e31b1547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:32.028165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb867324-7622-45b2-bb6d-8bd9e31b1547 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:32.037273 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1027/2036] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:32.057259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baf0e2-19f3-4d78-a92b-983ce63fa5e2 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:32.103104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:32.122317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baf0e2-19f3-4d78-a92b-983ce63fa5e2 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:32.127495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:32.128126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:32.128442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:32.128709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] PATH_INFO: `/v3/users/256d5952eef1431994c21b51ccdb77f7` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:32.129901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256d5952eef1431994c21b51ccdb77f7)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:32.131828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:32.179471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256d5952eef1431994c21b51ccdb77f7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:32.186818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256d5952eef1431994c21b51ccdb77f7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:32.199650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256d5952eef1431994c21b51ccdb77f7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:32.200395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256d5952eef1431994c21b51ccdb77f7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:32.201076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256d5952eef1431994c21b51ccdb77f7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:32.220945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1010/2037] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:32 2022] DELETE /identity/v3/users/256d5952eef1431994c21b51ccdb77f7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:32.225735 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c798e32-4769-4547-a7a1-70a3abde5207 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:32.226040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c798e32-4769-4547-a7a1-70a3abde5207 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:32.226334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c798e32-4769-4547-a7a1-70a3abde5207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:32.246541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9c798e32-4769-4547-a7a1-70a3abde5207 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:32.247851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9c798e32-4769-4547-a7a1-70a3abde5207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:32.288006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:32.309206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1028/2038] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:32.319068 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:32.320605 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:32.378216 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7041899-362f-429b-99a5-221753678d29 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:32.381976 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd026b6-f777-4b02-ab84-e240004ee668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:32.382586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd026b6-f777-4b02-ab84-e240004ee668 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:32.382855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd026b6-f777-4b02-ab84-e240004ee668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:32.383121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd026b6-f777-4b02-ab84-e240004ee668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:32.392167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd026b6-f777-4b02-ab84-e240004ee668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:32.393620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd026b6-f777-4b02-ab84-e240004ee668 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:32.402914 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1011/2039] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:32.678785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c798e32-4769-4547-a7a1-70a3abde5207 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:32.680235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9c798e32-4769-4547-a7a1-70a3abde5207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:32.693190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c798e32-4769-4547-a7a1-70a3abde5207 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:32.698810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:32.699456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:32.699737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:32.700009 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] PATH_INFO: `/v3/projects/5f1e694d96bc480da01b8b64ea98e242` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:32.701388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1e694d96bc480da01b8b64ea98e242)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:32.703338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:32.751003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1e694d96bc480da01b8b64ea98e242', 'request_id': 'req-81683e0c-1119-43b7-b09c-61bfbf8ba495'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:32.756413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1e694d96bc480da01b8b64ea98e242', 'request_id': 'req-81683e0c-1119-43b7-b09c-61bfbf8ba495'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:32.762410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1e694d96bc480da01b8b64ea98e242', 'request_id': 'req-81683e0c-1119-43b7-b09c-61bfbf8ba495'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:32.777543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] The token cache is being invalidate because project 5f1e694d96bc480da01b8b64ea98e242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:32.777832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:32.778537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-81683e0c-1119-43b7-b09c-61bfbf8ba495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:32.780122 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1029/2040] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:32 2022] DELETE /identity/v3/projects/5f1e694d96bc480da01b8b64ea98e242 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:32.785105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9e4f-0567-4c9f-8421-16bac3d6a1d5 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:32.785566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9e4f-0567-4c9f-8421-16bac3d6a1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:32.785659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9e4f-0567-4c9f-8421-16bac3d6a1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:32.806078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7b6e9e4f-0567-4c9f-8421-16bac3d6a1d5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:32.807250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7b6e9e4f-0567-4c9f-8421-16bac3d6a1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:32.868929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1012/2041] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:32.876845 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc9c6b-b706-4cd0-8afa-071b08ea27b9 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:32.877134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc9c6b-b706-4cd0-8afa-071b08ea27b9 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:32.877537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc9c6b-b706-4cd0-8afa-071b08ea27b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:32.897563 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-79dc9c6b-b706-4cd0-8afa-071b08ea27b9 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:32.898779 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-79dc9c6b-b706-4cd0-8afa-071b08ea27b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:32.906892 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1030/2042] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:32.911097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e9e4f-0567-4c9f-8421-16bac3d6a1d5 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:32.921047 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e9e4f-0567-4c9f-8421-16bac3d6a1d5 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:32.927115 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff7b43-e357-42e9-8b29-08283412bd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:32.927654 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff7b43-e357-42e9-8b29-08283412bd65 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:32.927927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff7b43-e357-42e9-8b29-08283412bd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:32.928190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff7b43-e357-42e9-8b29-08283412bd65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:32.928866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff7b43-e357-42e9-8b29-08283412bd65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:17:32.929165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff7b43-e357-42e9-8b29-08283412bd65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:32.930742 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff7b43-e357-42e9-8b29-08283412bd65 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:32.932368 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:32.946148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1013/2043] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:17:32.950468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc9c6b-b706-4cd0-8afa-071b08ea27b9 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:32.962987 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc9c6b-b706-4cd0-8afa-071b08ea27b9 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:32.969206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6a0c-112a-4e50-a245-188ccf047ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:32.969824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6a0c-112a-4e50-a245-188ccf047ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:32.970104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6a0c-112a-4e50-a245-188ccf047ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:32.970372 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6a0c-112a-4e50-a245-188ccf047ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:32.971006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6a0c-112a-4e50-a245-188ccf047ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:32.973016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6a0c-112a-4e50-a245-188ccf047ac7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:33.007930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1031/2044] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:17:32 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:33.013517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff7b43-e357-42e9-8b29-08283412bd65 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:33.024546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff7b43-e357-42e9-8b29-08283412bd65 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:33.081345 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfee9f-6fad-4fbe-af86-88aaf84d0413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:33.081947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfee9f-6fad-4fbe-af86-88aaf84d0413 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:33.082240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfee9f-6fad-4fbe-af86-88aaf84d0413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:33.082491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfee9f-6fad-4fbe-af86-88aaf84d0413 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:33.083135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfee9f-6fad-4fbe-af86-88aaf84d0413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:33.085095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfee9f-6fad-4fbe-af86-88aaf84d0413 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:33.107930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1014/2045] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:17:33 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:33.112511 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6a0c-112a-4e50-a245-188ccf047ac7 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:33.123154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6a0c-112a-4e50-a245-188ccf047ac7 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:33.128863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dcb82-8b1c-4559-95f2-ed68ec3f7946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:33.129500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dcb82-8b1c-4559-95f2-ed68ec3f7946 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:33.129779 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dcb82-8b1c-4559-95f2-ed68ec3f7946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:33.130055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dcb82-8b1c-4559-95f2-ed68ec3f7946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:33.130733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dcb82-8b1c-4559-95f2-ed68ec3f7946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:33.132384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dcb82-8b1c-4559-95f2-ed68ec3f7946 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:33.142628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1032/2046] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:33.146539 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfee9f-6fad-4fbe-af86-88aaf84d0413 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:33.156564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfee9f-6fad-4fbe-af86-88aaf84d0413 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:33.161296 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa45110-ef7e-419a-bcc9-6b030fbb152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:33.161889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa45110-ef7e-419a-bcc9-6b030fbb152e admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:33.162171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa45110-ef7e-419a-bcc9-6b030fbb152e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:33.162451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa45110-ef7e-419a-bcc9-6b030fbb152e admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:33.163090 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa45110-ef7e-419a-bcc9-6b030fbb152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:33.164736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa45110-ef7e-419a-bcc9-6b030fbb152e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:33.175532 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1015/2047] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:33.179756 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dcb82-8b1c-4559-95f2-ed68ec3f7946 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:33.190483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dcb82-8b1c-4559-95f2-ed68ec3f7946 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:33.196230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40c658-8562-4774-b972-a45603687aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:33.196907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40c658-8562-4774-b972-a45603687aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:33.197177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40c658-8562-4774-b972-a45603687aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:33.197446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40c658-8562-4774-b972-a45603687aaf admin admin] PATH_INFO: `/v3/projects/064727c471a04f5b86931ddd5ff9f4cd/users/366c1483d65d444ebb75d268459e2257/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:33.213800 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40c658-8562-4774-b972-a45603687aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=064727c471a04f5b86931ddd5ff9f4cd, user_id=366c1483d65d444ebb75d268459e2257, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:33.216580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40c658-8562-4774-b972-a45603687aaf admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:33.231750 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1033/2048] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:33 2022] PUT /identity/v3/projects/064727c471a04f5b86931ddd5ff9f4cd/users/366c1483d65d444ebb75d268459e2257/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:33.242660 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede03e9-3f83-4181-837e-9ff10c4e6231 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:33.242947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede03e9-3f83-4181-837e-9ff10c4e6231 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:33.243220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede03e9-3f83-4181-837e-9ff10c4e6231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:33.270838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-eede03e9-3f83-4181-837e-9ff10c4e6231 None None] MFA Rules not processed for user `366c1483d65d444ebb75d268459e2257`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:33.272027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-eede03e9-3f83-4181-837e-9ff10c4e6231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:33.341918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1016/2049] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:33.353403 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40c658-8562-4774-b972-a45603687aaf admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:33.355358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7d40c658-8562-4774-b972-a45603687aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:33.412149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40c658-8562-4774-b972-a45603687aaf admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:33.416819 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc263b63-8d62-4bf1-9793-e08096c8c74d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47768a5f86d4c6292099691f6cab1e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:33.417420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263b63-8d62-4bf1-9793-e08096c8c74d service glance] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:33.417694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263b63-8d62-4bf1-9793-e08096c8c74d service glance] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:33.417960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263b63-8d62-4bf1-9793-e08096c8c74d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:33.427210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc263b63-8d62-4bf1-9793-e08096c8c74d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:33.428669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc263b63-8d62-4bf1-9793-e08096c8c74d service glance] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:33.437688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1034/2050] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:34.989161 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede03e9-3f83-4181-837e-9ff10c4e6231 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:34.990666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-eede03e9-3f83-4181-837e-9ff10c4e6231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:35.054832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede03e9-3f83-4181-837e-9ff10c4e6231 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:35.058740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cc195-bd7e-4529-9d0e-62feda660b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:35.059364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cc195-bd7e-4529-9d0e-62feda660b93 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:35.060489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cc195-bd7e-4529-9d0e-62feda660b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:35.060489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cc195-bd7e-4529-9d0e-62feda660b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:35.063547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-081cc195-bd7e-4529-9d0e-62feda660b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:35.079607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:35.160406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cc195-bd7e-4529-9d0e-62feda660b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:35.161865 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cc195-bd7e-4529-9d0e-62feda660b93 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:35.175656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1017/2051] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:36.835198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc263b63-8d62-4bf1-9793-e08096c8c74d service glance] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:36.836609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-dc263b63-8d62-4bf1-9793-e08096c8c74d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:36.861848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:36.904732 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc263b63-8d62-4bf1-9793-e08096c8c74d service glance] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:36.908696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c5bad-4944-4830-8d48-32b52bb0cb65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:36.909298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c5bad-4944-4830-8d48-32b52bb0cb65 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:36.909572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c5bad-4944-4830-8d48-32b52bb0cb65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:36.909839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c5bad-4944-4830-8d48-32b52bb0cb65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:36.911683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5a9c5bad-4944-4830-8d48-32b52bb0cb65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:36.927436 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c5bad-4944-4830-8d48-32b52bb0cb65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:36.928927 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c5bad-4944-4830-8d48-32b52bb0cb65 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:36.940421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1035/2052] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:38.882166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cc195-bd7e-4529-9d0e-62feda660b93 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:38.883892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-081cc195-bd7e-4529-9d0e-62feda660b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:38.896780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cc195-bd7e-4529-9d0e-62feda660b93 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:38.901135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f91abf-b6b5-48be-b12b-1883a674e219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:38.901892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f91abf-b6b5-48be-b12b-1883a674e219 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:38.902082 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f91abf-b6b5-48be-b12b-1883a674e219 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:38.902368 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f91abf-b6b5-48be-b12b-1883a674e219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:38.904314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b2f91abf-b6b5-48be-b12b-1883a674e219 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:38.971267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f91abf-b6b5-48be-b12b-1883a674e219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:38.972818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f91abf-b6b5-48be-b12b-1883a674e219 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:38.982683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1018/2053] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:45.542859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad13d-9e80-45aa-9c89-aaa4b3f8a53c None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:45.543596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad13d-9e80-45aa-9c89-aaa4b3f8a53c None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:45.544082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad13d-9e80-45aa-9c89-aaa4b3f8a53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:45.573696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a76ad13d-9e80-45aa-9c89-aaa4b3f8a53c None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:45.575347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a76ad13d-9e80-45aa-9c89-aaa4b3f8a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:45.630734 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1036/2054] 10.222.0.15 () {58 vars in 967 bytes} [Mon Oct 24 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:45.678431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f91abf-b6b5-48be-b12b-1883a674e219 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:45.679963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b2f91abf-b6b5-48be-b12b-1883a674e219 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:45.758962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f91abf-b6b5-48be-b12b-1883a674e219 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:45.764634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7403c-6502-4dbf-bc1e-683a4d4399f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:45.765360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7403c-6502-4dbf-bc1e-683a4d4399f8 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:45.765639 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7403c-6502-4dbf-bc1e-683a4d4399f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:45.765941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7403c-6502-4dbf-bc1e-683a4d4399f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:45.775175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7403c-6502-4dbf-bc1e-683a4d4399f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:45.776970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7403c-6502-4dbf-bc1e-683a4d4399f8 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:45.786899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1019/2055] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:17:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:17:50.258705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ad13d-9e80-45aa-9c89-aaa4b3f8a53c None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:50.341788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ad13d-9e80-45aa-9c89-aaa4b3f8a53c None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:50.349906 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:50.350602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:50.351715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:50.351715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] PATH_INFO: `/v3/users/366c1483d65d444ebb75d268459e2257` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:50.353344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=366c1483d65d444ebb75d268459e2257)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:50.354351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:50.445882 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366c1483d65d444ebb75d268459e2257'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:50.456915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366c1483d65d444ebb75d268459e2257'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:50.457740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366c1483d65d444ebb75d268459e2257'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:50.459101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:50.477008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366c1483d65d444ebb75d268459e2257'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:50.477811 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366c1483d65d444ebb75d268459e2257'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:50.507393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1037/2056] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:50 2022] DELETE /identity/v3/users/366c1483d65d444ebb75d268459e2257 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:50.509517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f009107-5786-4352-88b1-4a8ab322cb8c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:50.509950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f009107-5786-4352-88b1-4a8ab322cb8c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:50.510072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f009107-5786-4352-88b1-4a8ab322cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:50.534285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-6f009107-5786-4352-88b1-4a8ab322cb8c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:50.535635 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6f009107-5786-4352-88b1-4a8ab322cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:50.567808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:50.625472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1020/2057] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:17:50.637247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:50.638759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:50.706889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde8808-872b-417d-90aa-637df0baeb97 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:50.710504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd56d1-2526-4bc3-9a31-e089980747e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:50.711120 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd56d1-2526-4bc3-9a31-e089980747e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:50.711405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd56d1-2526-4bc3-9a31-e089980747e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:50.711673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd56d1-2526-4bc3-9a31-e089980747e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:50.721144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd56d1-2526-4bc3-9a31-e089980747e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:50.722706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd56d1-2526-4bc3-9a31-e089980747e9 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:50.733500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1038/2058] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:17:51.220267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f009107-5786-4352-88b1-4a8ab322cb8c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:51.222364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6f009107-5786-4352-88b1-4a8ab322cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:51.250367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f009107-5786-4352-88b1-4a8ab322cb8c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:51.262479 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:51.264386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:51.265276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:51.267299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] PATH_INFO: `/v3/projects/064727c471a04f5b86931ddd5ff9f4cd` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:51.269248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=064727c471a04f5b86931ddd5ff9f4cd)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:51.273977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:51.360087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064727c471a04f5b86931ddd5ff9f4cd', 'request_id': 'req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:51.373606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064727c471a04f5b86931ddd5ff9f4cd', 'request_id': 'req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:51.384681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064727c471a04f5b86931ddd5ff9f4cd', 'request_id': 'req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:51.407202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] The token cache is being invalidate because project 064727c471a04f5b86931ddd5ff9f4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:51.407632 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:51.408409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c20ced72-0f9d-4c1d-9d6c-e06f9479de4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:51.410813 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1021/2059] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:51 2022] DELETE /identity/v3/projects/064727c471a04f5b86931ddd5ff9f4cd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:51.415713 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfc4d-2019-453b-8c76-24aae9c996e3 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:51.416244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfc4d-2019-453b-8c76-24aae9c996e3 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:51.416244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfc4d-2019-453b-8c76-24aae9c996e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:51.450359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-112bfc4d-2019-453b-8c76-24aae9c996e3 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:51.451151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-112bfc4d-2019-453b-8c76-24aae9c996e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:51.593760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1039/2060] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:51.595521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902e9f-2015-4377-a381-fb2be2f56383 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:51.596009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902e9f-2015-4377-a381-fb2be2f56383 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:51.596280 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902e9f-2015-4377-a381-fb2be2f56383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:51.636018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-99902e9f-2015-4377-a381-fb2be2f56383 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:51.637261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-99902e9f-2015-4377-a381-fb2be2f56383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:51.656913 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1022/2061] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:51.661073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bfc4d-2019-453b-8c76-24aae9c996e3 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:51.678069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bfc4d-2019-453b-8c76-24aae9c996e3 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:51.684378 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544a099-37f2-4aa9-bbb0-8f9156384689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:51.685083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a099-37f2-4aa9-bbb0-8f9156384689 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:51.685551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a099-37f2-4aa9-bbb0-8f9156384689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:51.686016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a099-37f2-4aa9-bbb0-8f9156384689 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:51.686849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544a099-37f2-4aa9-bbb0-8f9156384689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:17:51.687222 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544a099-37f2-4aa9-bbb0-8f9156384689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:51.688963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544a099-37f2-4aa9-bbb0-8f9156384689 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:51.708611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1040/2062] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:17:51.713629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99902e9f-2015-4377-a381-fb2be2f56383 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:51.731954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99902e9f-2015-4377-a381-fb2be2f56383 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:51.747801 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae2805-afdb-48e5-a055-3cf42e7c768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:51.749486 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae2805-afdb-48e5-a055-3cf42e7c768d admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:51.749887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae2805-afdb-48e5-a055-3cf42e7c768d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:51.750282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae2805-afdb-48e5-a055-3cf42e7c768d admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:51.751546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae2805-afdb-48e5-a055-3cf42e7c768d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:51.753828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae2805-afdb-48e5-a055-3cf42e7c768d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:51.821439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1023/2063] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:17:51 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:51.825509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544a099-37f2-4aa9-bbb0-8f9156384689 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:51.839077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544a099-37f2-4aa9-bbb0-8f9156384689 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:51.971734 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3744932-baf0-4137-8b54-8d2e5d3a304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:51.972493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3744932-baf0-4137-8b54-8d2e5d3a304b admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:51.972835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3744932-baf0-4137-8b54-8d2e5d3a304b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:51.973175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3744932-baf0-4137-8b54-8d2e5d3a304b admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:51.973901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3744932-baf0-4137-8b54-8d2e5d3a304b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:51.975960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3744932-baf0-4137-8b54-8d2e5d3a304b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:51.993686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:52.019257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1041/2064] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:17:51 2022] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:17:52.023526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae2805-afdb-48e5-a055-3cf42e7c768d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:52.040645 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae2805-afdb-48e5-a055-3cf42e7c768d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:52.046487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0802785-4f92-4d59-91e6-6c0ff68eec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:52.047563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802785-4f92-4d59-91e6-6c0ff68eec2d admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:52.047955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802785-4f92-4d59-91e6-6c0ff68eec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:52.048414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802785-4f92-4d59-91e6-6c0ff68eec2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:52.049530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0802785-4f92-4d59-91e6-6c0ff68eec2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:52.052111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0802785-4f92-4d59-91e6-6c0ff68eec2d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:52.063829 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1024/2065] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:17:52.068200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3744932-baf0-4137-8b54-8d2e5d3a304b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:52.086628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3744932-baf0-4137-8b54-8d2e5d3a304b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:52.095023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd22e7-9be9-4f0e-877f-d2fd3dd955fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:52.095819 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd22e7-9be9-4f0e-877f-d2fd3dd955fc admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:52.096202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd22e7-9be9-4f0e-877f-d2fd3dd955fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:52.096608 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd22e7-9be9-4f0e-877f-d2fd3dd955fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:52.097347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd22e7-9be9-4f0e-877f-d2fd3dd955fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:52.100864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd22e7-9be9-4f0e-877f-d2fd3dd955fc admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:52.121031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1042/2066] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:17:52.125329 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0802785-4f92-4d59-91e6-6c0ff68eec2d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:52.141040 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0802785-4f92-4d59-91e6-6c0ff68eec2d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:52.146578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127062e8-206b-40dd-a4b5-0b5f502a745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:52.147790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127062e8-206b-40dd-a4b5-0b5f502a745a admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:52.148094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127062e8-206b-40dd-a4b5-0b5f502a745a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:52.148554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127062e8-206b-40dd-a4b5-0b5f502a745a admin admin] PATH_INFO: `/v3/projects/8d7edbd6ab2542e2844fd8821dcd29c7/users/c376f68768b044d78ea868be228d9d1a/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:52.174465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127062e8-206b-40dd-a4b5-0b5f502a745a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7edbd6ab2542e2844fd8821dcd29c7, user_id=c376f68768b044d78ea868be228d9d1a, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:52.177599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127062e8-206b-40dd-a4b5-0b5f502a745a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:52.196781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1025/2067] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:17:52 2022] PUT /identity/v3/projects/8d7edbd6ab2542e2844fd8821dcd29c7/users/c376f68768b044d78ea868be228d9d1a/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:52.208538 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a3952-e113-4c0e-9bab-7f97244e42da None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:52.209577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a3952-e113-4c0e-9bab-7f97244e42da None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:52.209883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a3952-e113-4c0e-9bab-7f97244e42da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:52.269834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-6c6a3952-e113-4c0e-9bab-7f97244e42da None None] MFA Rules not processed for user `c376f68768b044d78ea868be228d9d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:17:52.271291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6c6a3952-e113-4c0e-9bab-7f97244e42da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:52.375363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1043/2068] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:17:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:17:52.388512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127062e8-206b-40dd-a4b5-0b5f502a745a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:52.390562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-127062e8-206b-40dd-a4b5-0b5f502a745a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:52.480886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127062e8-206b-40dd-a4b5-0b5f502a745a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:52.486523 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be5fb-7fda-4b77-83fd-5381ad4d2fa9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47768a5f86d4c6292099691f6cab1e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:52.487215 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be5fb-7fda-4b77-83fd-5381ad4d2fa9 service glance] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:52.487609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be5fb-7fda-4b77-83fd-5381ad4d2fa9 service glance] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:52.487948 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be5fb-7fda-4b77-83fd-5381ad4d2fa9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:52.495280 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:52.499697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264be5fb-7fda-4b77-83fd-5381ad4d2fa9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:52.501756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264be5fb-7fda-4b77-83fd-5381ad4d2fa9 service glance] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:52.513648 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1026/2069] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:17:53.425879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a3952-e113-4c0e-9bab-7f97244e42da None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:53.427905 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6c6a3952-e113-4c0e-9bab-7f97244e42da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:53.504981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a3952-e113-4c0e-9bab-7f97244e42da None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:53.509425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:53.510061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:53.510571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:53.510689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] PATH_INFO: `/v3/users/57decc229903408e873b5d976fd309c2` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:53.511716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57decc229903408e873b5d976fd309c2)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:53.513767 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:53.566003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57decc229903408e873b5d976fd309c2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:53.573483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57decc229903408e873b5d976fd309c2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:53.574252 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57decc229903408e873b5d976fd309c2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:53.590092 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57decc229903408e873b5d976fd309c2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:53.591517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57decc229903408e873b5d976fd309c2'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:53.593486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:53.613125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1044/2070] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:53 2022] DELETE /identity/v3/users/57decc229903408e873b5d976fd309c2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:53.838496 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be5fb-7fda-4b77-83fd-5381ad4d2fa9 service glance] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:53.849969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be5fb-7fda-4b77-83fd-5381ad4d2fa9 service glance] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:53.922926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:53.923892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:53.924085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:53.924387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] PATH_INFO: `/v3/projects/a2b4860b53824bbd998533a60570b0ff` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:53.925510 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b4860b53824bbd998533a60570b0ff)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:53.927515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:53.981085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b4860b53824bbd998533a60570b0ff', 'request_id': 'req-0500504e-3e04-4b74-ab13-1b4161d3e2fc'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:53.989963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b4860b53824bbd998533a60570b0ff', 'request_id': 'req-0500504e-3e04-4b74-ab13-1b4161d3e2fc'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:53.996308 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b4860b53824bbd998533a60570b0ff', 'request_id': 'req-0500504e-3e04-4b74-ab13-1b4161d3e2fc'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.006455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] The token cache is being invalidate because project a2b4860b53824bbd998533a60570b0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:54.006739 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.007373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.008868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1027/2071] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:53 2022] DELETE /identity/v3/projects/a2b4860b53824bbd998533a60570b0ff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:54.013250 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:54.014827 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:54.028925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533fc8-60dc-4917-ba23-c48b8250a4e5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:54.084621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:54.085298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:54.085642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:54.085933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] PATH_INFO: `/v3/users/479866c6e7b84004841c295be59bf439` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:54.087108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=479866c6e7b84004841c295be59bf439)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:54.089207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:54.144485 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479866c6e7b84004841c295be59bf439'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.152136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479866c6e7b84004841c295be59bf439'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.153021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479866c6e7b84004841c295be59bf439'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.165624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479866c6e7b84004841c295be59bf439'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.166397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479866c6e7b84004841c295be59bf439'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.179689 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1045/2072] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:17:54 2022] DELETE /identity/v3/users/479866c6e7b84004841c295be59bf439 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:54.372454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:54.374176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:54.393004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500504e-3e04-4b74-ab13-1b4161d3e2fc admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:54.452879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:54.453513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:54.453788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:54.454057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] PATH_INFO: `/v3/projects/dc28c6bf0eef469388323be69760b076` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:54.455180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc28c6bf0eef469388323be69760b076)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:54.457129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:54.489524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:54.508554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc28c6bf0eef469388323be69760b076', 'request_id': 'req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.517294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc28c6bf0eef469388323be69760b076', 'request_id': 'req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.523641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc28c6bf0eef469388323be69760b076', 'request_id': 'req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.535020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] The token cache is being invalidate because project dc28c6bf0eef469388323be69760b076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:17:54.535305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.536004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:17:54.537524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1028/2073] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:17:54 2022] DELETE /identity/v3/projects/dc28c6bf0eef469388323be69760b076 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:17:57.422736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:17:57.424299 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:57.488421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5be27f-b69f-4d3a-b3c6-5690f5240071 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:17:57.514709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:57.547164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ae2a-cc7c-469c-b549-b586a4c186d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:17:57.547788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ae2a-cc7c-469c-b549-b586a4c186d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:17:57.548069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ae2a-cc7c-469c-b549-b586a4c186d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:17:57.548406 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ae2a-cc7c-469c-b549-b586a4c186d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:17:57.550331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b140ae2a-cc7c-469c-b549-b586a4c186d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:17:57.618508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140ae2a-cc7c-469c-b549-b586a4c186d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:17:57.619855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140ae2a-cc7c-469c-b549-b586a4c186d9 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:17:57.629658 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1046/2074] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:00.674879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:00.677714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:00.699417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d8542-a6cd-45c8-b2c2-32ba6d952bca admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:00.704326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:00.705157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:00.705523 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:00.705864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] PATH_INFO: `/v3/users/169da6fc9b04431a9fcf7580c65ab1a3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:00.707008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=169da6fc9b04431a9fcf7580c65ab1a3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:00.709084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:00.763681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169da6fc9b04431a9fcf7580c65ab1a3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:00.770665 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169da6fc9b04431a9fcf7580c65ab1a3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:00.782415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169da6fc9b04431a9fcf7580c65ab1a3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:00.783077 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169da6fc9b04431a9fcf7580c65ab1a3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:00.783675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bc10a534-e76c-4631-b8ae-36003a445ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169da6fc9b04431a9fcf7580c65ab1a3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:00.797305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1029/2075] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:00 2022] DELETE /identity/v3/users/169da6fc9b04431a9fcf7580c65ab1a3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:00.990387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ae2a-cc7c-469c-b549-b586a4c186d9 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:01.000916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ae2a-cc7c-469c-b549-b586a4c186d9 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:01.061525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:01.062167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.062443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.062712 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] PATH_INFO: `/v3/projects/b1aaed987ac54150b152e95d0d8e1e3f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.063932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1aaed987ac54150b152e95d0d8e1e3f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:01.065896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:01.116355 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1aaed987ac54150b152e95d0d8e1e3f', 'request_id': 'req-5733257a-9074-4852-a4e5-4eb25ddb8af0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:01.124289 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1aaed987ac54150b152e95d0d8e1e3f', 'request_id': 'req-5733257a-9074-4852-a4e5-4eb25ddb8af0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:01.130860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1aaed987ac54150b152e95d0d8e1e3f', 'request_id': 'req-5733257a-9074-4852-a4e5-4eb25ddb8af0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:01.145311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] The token cache is being invalidate because project b1aaed987ac54150b152e95d0d8e1e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:01.145593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:01.146318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-5733257a-9074-4852-a4e5-4eb25ddb8af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:01.147961 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1047/2076] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:00 2022] DELETE /identity/v3/projects/b1aaed987ac54150b152e95d0d8e1e3f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:01.153141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c59408-107c-485d-a553-953b5ecc9b60 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.153424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c59408-107c-485d-a553-953b5ecc9b60 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.153695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c59408-107c-485d-a553-953b5ecc9b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.174734 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a4c59408-107c-485d-a553-953b5ecc9b60 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:01.175980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a4c59408-107c-485d-a553-953b5ecc9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:01.235609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1030/2077] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:01.243938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e995c-37df-425d-adf8-4410bfac12b0 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.244225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e995c-37df-425d-adf8-4410bfac12b0 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.244513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e995c-37df-425d-adf8-4410bfac12b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.261948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:01.269957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-6f9e995c-37df-425d-adf8-4410bfac12b0 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:01.272801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-6f9e995c-37df-425d-adf8-4410bfac12b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:01.285815 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1048/2078] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:01.291701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c59408-107c-485d-a553-953b5ecc9b60 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:01.302068 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c59408-107c-485d-a553-953b5ecc9b60 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:01.308335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deeb74-62bb-42e0-911d-9a86a1cfa0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:01.308980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deeb74-62bb-42e0-911d-9a86a1cfa0bb admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.309266 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deeb74-62bb-42e0-911d-9a86a1cfa0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.309530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deeb74-62bb-42e0-911d-9a86a1cfa0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.310202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8deeb74-62bb-42e0-911d-9a86a1cfa0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:01.310503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8deeb74-62bb-42e0-911d-9a86a1cfa0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:01.312272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8deeb74-62bb-42e0-911d-9a86a1cfa0bb admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:01.324282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1031/2079] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:01.329118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e995c-37df-425d-adf8-4410bfac12b0 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:01.339120 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e995c-37df-425d-adf8-4410bfac12b0 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:01.343931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca214fc7-8bd2-498a-b5c3-9694c70ed8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:01.344571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca214fc7-8bd2-498a-b5c3-9694c70ed8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.344845 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca214fc7-8bd2-498a-b5c3-9694c70ed8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.345112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca214fc7-8bd2-498a-b5c3-9694c70ed8b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.345743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca214fc7-8bd2-498a-b5c3-9694c70ed8b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:01.347634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca214fc7-8bd2-498a-b5c3-9694c70ed8b5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:01.376925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1049/2080] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:01 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:01.381476 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deeb74-62bb-42e0-911d-9a86a1cfa0bb admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:01.392741 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deeb74-62bb-42e0-911d-9a86a1cfa0bb admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:01.408276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:01.463346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1be9f-8ba9-4ce6-8732-d5cfc2bef2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:01.463946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1be9f-8ba9-4ce6-8732-d5cfc2bef2ac admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.464223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1be9f-8ba9-4ce6-8732-d5cfc2bef2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.464524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1be9f-8ba9-4ce6-8732-d5cfc2bef2ac admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.465208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1be9f-8ba9-4ce6-8732-d5cfc2bef2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:01.467295 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1be9f-8ba9-4ce6-8732-d5cfc2bef2ac admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:01.495455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1032/2081] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:01 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:01.501081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca214fc7-8bd2-498a-b5c3-9694c70ed8b5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:01.511293 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca214fc7-8bd2-498a-b5c3-9694c70ed8b5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:01.516646 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8aedf-2912-4c8e-8e61-26d45f1dfcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:01.517246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8aedf-2912-4c8e-8e61-26d45f1dfcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.517523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8aedf-2912-4c8e-8e61-26d45f1dfcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.517793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8aedf-2912-4c8e-8e61-26d45f1dfcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.518439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8aedf-2912-4c8e-8e61-26d45f1dfcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:01.520047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8aedf-2912-4c8e-8e61-26d45f1dfcc4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:01.531103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1050/2082] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:01.535152 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1be9f-8ba9-4ce6-8732-d5cfc2bef2ac admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:01.546981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1be9f-8ba9-4ce6-8732-d5cfc2bef2ac admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:01.552669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce530f-b689-4ff5-b204-5bf372d29e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:01.553286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce530f-b689-4ff5-b204-5bf372d29e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.553561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce530f-b689-4ff5-b204-5bf372d29e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.553834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce530f-b689-4ff5-b204-5bf372d29e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.554485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce530f-b689-4ff5-b204-5bf372d29e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:01.556126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce530f-b689-4ff5-b204-5bf372d29e1e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:01.567569 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1033/2083] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:01.571968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8aedf-2912-4c8e-8e61-26d45f1dfcc4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:01.582234 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8aedf-2912-4c8e-8e61-26d45f1dfcc4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:01.586914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8614e-76d6-4f2c-a923-640622551011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:01.587561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8614e-76d6-4f2c-a923-640622551011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.587841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8614e-76d6-4f2c-a923-640622551011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.588109 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8614e-76d6-4f2c-a923-640622551011 admin admin] PATH_INFO: `/v3/projects/35673370ddc2405d99f0d674ba3785b0/users/aa61b1bbf73143ab9d77e7d96dba978f/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.603221 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8614e-76d6-4f2c-a923-640622551011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35673370ddc2405d99f0d674ba3785b0, user_id=aa61b1bbf73143ab9d77e7d96dba978f, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:01.605978 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8614e-76d6-4f2c-a923-640622551011 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:01.625992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1051/2084] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:01 2022] PUT /identity/v3/projects/35673370ddc2405d99f0d674ba3785b0/users/aa61b1bbf73143ab9d77e7d96dba978f/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:01.638353 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6660a-e1ab-471b-8b12-fc674fa52c8b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.639151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6660a-e1ab-471b-8b12-fc674fa52c8b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.639404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6660a-e1ab-471b-8b12-fc674fa52c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.676752 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-47f6660a-e1ab-471b-8b12-fc674fa52c8b None None] MFA Rules not processed for user `aa61b1bbf73143ab9d77e7d96dba978f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:01.678010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-47f6660a-e1ab-471b-8b12-fc674fa52c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:01.746123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1034/2085] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:01.757782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8614e-76d6-4f2c-a923-640622551011 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:01.759789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1af8614e-76d6-4f2c-a923-640622551011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:01.845189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8614e-76d6-4f2c-a923-640622551011 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:01.852010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e58a6-9f6d-4b24-bf72-00a64d3f7213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:01.852693 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e58a6-9f6d-4b24-bf72-00a64d3f7213 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:01.852965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e58a6-9f6d-4b24-bf72-00a64d3f7213 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:01.853232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e58a6-9f6d-4b24-bf72-00a64d3f7213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:01.862555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e58a6-9f6d-4b24-bf72-00a64d3f7213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:01.864245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e58a6-9f6d-4b24-bf72-00a64d3f7213 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:01.874759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1052/2086] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:02.088590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6660a-e1ab-471b-8b12-fc674fa52c8b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:02.155964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6660a-e1ab-471b-8b12-fc674fa52c8b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:02.161084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:02.161723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:02.162001 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:02.162273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] PATH_INFO: `/v3/users/aa61b1bbf73143ab9d77e7d96dba978f` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:02.163391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa61b1bbf73143ab9d77e7d96dba978f)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:02.165373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:02.189898 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:02.224225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa61b1bbf73143ab9d77e7d96dba978f'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:02.232745 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa61b1bbf73143ab9d77e7d96dba978f'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:02.251432 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa61b1bbf73143ab9d77e7d96dba978f'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:02.252157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa61b1bbf73143ab9d77e7d96dba978f'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:02.252855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa61b1bbf73143ab9d77e7d96dba978f'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:02.268584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1035/2087] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:02 2022] DELETE /identity/v3/users/aa61b1bbf73143ab9d77e7d96dba978f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:02.273456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec626a97-65f6-44f1-8cca-ddc8cc47e149 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:02.274111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec626a97-65f6-44f1-8cca-ddc8cc47e149 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:02.274111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec626a97-65f6-44f1-8cca-ddc8cc47e149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:02.294613 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ec626a97-65f6-44f1-8cca-ddc8cc47e149 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:02.296453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ec626a97-65f6-44f1-8cca-ddc8cc47e149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:02.356458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1053/2088] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:02.367116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:02.368822 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:02.439754 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dad30-a8a8-4144-8cac-fd22fff64a4d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:02.443643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983fd5f-ffd4-404f-9575-f199554f06b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:02.444263 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983fd5f-ffd4-404f-9575-f199554f06b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:02.444556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983fd5f-ffd4-404f-9575-f199554f06b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:02.444833 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983fd5f-ffd4-404f-9575-f199554f06b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:02.458919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983fd5f-ffd4-404f-9575-f199554f06b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:02.460436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983fd5f-ffd4-404f-9575-f199554f06b2 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:02.470671 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1036/2089] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:02.750887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec626a97-65f6-44f1-8cca-ddc8cc47e149 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:02.752438 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ec626a97-65f6-44f1-8cca-ddc8cc47e149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:02.766309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec626a97-65f6-44f1-8cca-ddc8cc47e149 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:02.772117 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:02.772836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:02.773191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:02.773503 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] PATH_INFO: `/v3/projects/35673370ddc2405d99f0d674ba3785b0` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:02.774783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35673370ddc2405d99f0d674ba3785b0)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:02.777089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:02.803792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:02.828085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35673370ddc2405d99f0d674ba3785b0', 'request_id': 'req-9e129138-684f-48a8-86a4-b296bb536cf7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:02.833495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35673370ddc2405d99f0d674ba3785b0', 'request_id': 'req-9e129138-684f-48a8-86a4-b296bb536cf7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:02.839612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35673370ddc2405d99f0d674ba3785b0', 'request_id': 'req-9e129138-684f-48a8-86a4-b296bb536cf7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:02.853156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] The token cache is being invalidate because project 35673370ddc2405d99f0d674ba3785b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:02.853465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:02.854097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9e129138-684f-48a8-86a4-b296bb536cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:02.855864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1054/2090] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:02 2022] DELETE /identity/v3/projects/35673370ddc2405d99f0d674ba3785b0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:02.861450 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8533c23-d336-4c8e-b03a-d43e078cde1e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:02.862017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8533c23-d336-4c8e-b03a-d43e078cde1e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:02.862017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8533c23-d336-4c8e-b03a-d43e078cde1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:02.881784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b8533c23-d336-4c8e-b03a-d43e078cde1e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:02.882975 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b8533c23-d336-4c8e-b03a-d43e078cde1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:02.942718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1037/2091] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:02.950922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ce9f9-880b-4bbd-be60-7f5dd17529c5 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:02.951243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ce9f9-880b-4bbd-be60-7f5dd17529c5 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:02.951522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ce9f9-880b-4bbd-be60-7f5dd17529c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:02.971449 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-785ce9f9-880b-4bbd-be60-7f5dd17529c5 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:02.972694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-785ce9f9-880b-4bbd-be60-7f5dd17529c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:02.980712 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1055/2092] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:02.984821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8533c23-d336-4c8e-b03a-d43e078cde1e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:02.995113 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8533c23-d336-4c8e-b03a-d43e078cde1e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:02.999915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26830c6-19e0-4f50-b850-d940c3a81f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.000626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26830c6-19e0-4f50-b850-d940c3a81f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.000904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26830c6-19e0-4f50-b850-d940c3a81f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.001176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26830c6-19e0-4f50-b850-d940c3a81f20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.001851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26830c6-19e0-4f50-b850-d940c3a81f20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:03.002141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26830c6-19e0-4f50-b850-d940c3a81f20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.003765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26830c6-19e0-4f50-b850-d940c3a81f20 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.016037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1038/2093] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:03.020663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ce9f9-880b-4bbd-be60-7f5dd17529c5 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.030586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ce9f9-880b-4bbd-be60-7f5dd17529c5 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.035833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d87a1-9252-4f98-a339-8aa4802130ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.036477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d87a1-9252-4f98-a339-8aa4802130ab admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.036762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d87a1-9252-4f98-a339-8aa4802130ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.037039 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d87a1-9252-4f98-a339-8aa4802130ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.037684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d87a1-9252-4f98-a339-8aa4802130ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.039597 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d87a1-9252-4f98-a339-8aa4802130ab admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.069982 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1056/2094] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:03 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:03.075507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26830c6-19e0-4f50-b850-d940c3a81f20 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.086551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26830c6-19e0-4f50-b850-d940c3a81f20 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.116899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:03.156278 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ab09b-edde-49d4-a1b4-ea6a80698e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.156907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ab09b-edde-49d4-a1b4-ea6a80698e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.157181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ab09b-edde-49d4-a1b4-ea6a80698e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.157448 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ab09b-edde-49d4-a1b4-ea6a80698e43 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.158080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ab09b-edde-49d4-a1b4-ea6a80698e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.159993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ab09b-edde-49d4-a1b4-ea6a80698e43 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.184027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1039/2095] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:03 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:03.188423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d87a1-9252-4f98-a339-8aa4802130ab admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.198983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d87a1-9252-4f98-a339-8aa4802130ab admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.204156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6b8d0-96be-45e5-8387-ead8050d5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.204818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6b8d0-96be-45e5-8387-ead8050d5569 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.205101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6b8d0-96be-45e5-8387-ead8050d5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.205490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6b8d0-96be-45e5-8387-ead8050d5569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.206227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6b8d0-96be-45e5-8387-ead8050d5569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.207855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6b8d0-96be-45e5-8387-ead8050d5569 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.222455 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1057/2096] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:03.227742 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ab09b-edde-49d4-a1b4-ea6a80698e43 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.243388 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ab09b-edde-49d4-a1b4-ea6a80698e43 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.250029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37282-534b-48ce-8187-85d2fd88e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.250628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37282-534b-48ce-8187-85d2fd88e266 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.250903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37282-534b-48ce-8187-85d2fd88e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.251170 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37282-534b-48ce-8187-85d2fd88e266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.251809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37282-534b-48ce-8187-85d2fd88e266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.253461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37282-534b-48ce-8187-85d2fd88e266 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.264561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1040/2097] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:03.269064 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6b8d0-96be-45e5-8387-ead8050d5569 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.279629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6b8d0-96be-45e5-8387-ead8050d5569 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.286117 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c458f-f6ae-42b3-b133-364104b8c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.286774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c458f-f6ae-42b3-b133-364104b8c6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.287055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c458f-f6ae-42b3-b133-364104b8c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.287311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c458f-f6ae-42b3-b133-364104b8c6ff admin admin] PATH_INFO: `/v3/projects/53436d261a754d3ba87af50a9e178677/users/15b205db2c4b4bf59e26a52aa09d556f/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.306029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c458f-f6ae-42b3-b133-364104b8c6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=53436d261a754d3ba87af50a9e178677, user_id=15b205db2c4b4bf59e26a52aa09d556f, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.309702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c458f-f6ae-42b3-b133-364104b8c6ff admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.326260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1058/2098] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:03 2022] PUT /identity/v3/projects/53436d261a754d3ba87af50a9e178677/users/15b205db2c4b4bf59e26a52aa09d556f/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:03.337111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974581-7f64-44fc-848c-d340d0afdbd5 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.337274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974581-7f64-44fc-848c-d340d0afdbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.337522 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974581-7f64-44fc-848c-d340d0afdbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.366064 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8d974581-7f64-44fc-848c-d340d0afdbd5 None None] MFA Rules not processed for user `15b205db2c4b4bf59e26a52aa09d556f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:03.367225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8d974581-7f64-44fc-848c-d340d0afdbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:03.436756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1041/2099] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:03.441600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c458f-f6ae-42b3-b133-364104b8c6ff admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.508276 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c458f-f6ae-42b3-b133-364104b8c6ff admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.514962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c0168-1ffc-40c8-b5c0-d16767458b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.515570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0168-1ffc-40c8-b5c0-d16767458b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.515849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0168-1ffc-40c8-b5c0-d16767458b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.516117 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0168-1ffc-40c8-b5c0-d16767458b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.516803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c0168-1ffc-40c8-b5c0-d16767458b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.518717 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c0168-1ffc-40c8-b5c0-d16767458b02 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.551992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1059/2100] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:03 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:03.556232 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d974581-7f64-44fc-848c-d340d0afdbd5 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.567409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d974581-7f64-44fc-848c-d340d0afdbd5 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.624641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8899ee3-3910-4d25-8207-ee8a4dec696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.625720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899ee3-3910-4d25-8207-ee8a4dec696f admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.625720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899ee3-3910-4d25-8207-ee8a4dec696f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.625720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899ee3-3910-4d25-8207-ee8a4dec696f admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.626340 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8899ee3-3910-4d25-8207-ee8a4dec696f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.628273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8899ee3-3910-4d25-8207-ee8a4dec696f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.651593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1042/2101] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:03 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:03.655471 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c0168-1ffc-40c8-b5c0-d16767458b02 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.666021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c0168-1ffc-40c8-b5c0-d16767458b02 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.671127 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1464d0-aef9-4c5c-a673-04ee08046d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.671739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1464d0-aef9-4c5c-a673-04ee08046d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.672055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1464d0-aef9-4c5c-a673-04ee08046d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.672317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1464d0-aef9-4c5c-a673-04ee08046d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.673003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1464d0-aef9-4c5c-a673-04ee08046d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.674591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1464d0-aef9-4c5c-a673-04ee08046d6a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.685509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1060/2102] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:03.690047 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8899ee3-3910-4d25-8207-ee8a4dec696f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.700974 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8899ee3-3910-4d25-8207-ee8a4dec696f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.709118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d4ec5-8ce7-4fcd-afdb-674b1fe3103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.710087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d4ec5-8ce7-4fcd-afdb-674b1fe3103e admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.710446 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d4ec5-8ce7-4fcd-afdb-674b1fe3103e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.710701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d4ec5-8ce7-4fcd-afdb-674b1fe3103e admin admin] PATH_INFO: `/v3/projects/7bcfc17ec65147cd949b51e9d9681cd0/users/dd1764c165c04e2aa4c3c071296df4f0/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.728072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d4ec5-8ce7-4fcd-afdb-674b1fe3103e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bcfc17ec65147cd949b51e9d9681cd0, user_id=dd1764c165c04e2aa4c3c071296df4f0, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.730843 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d4ec5-8ce7-4fcd-afdb-674b1fe3103e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.746117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1043/2103] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:03 2022] PUT /identity/v3/projects/7bcfc17ec65147cd949b51e9d9681cd0/users/dd1764c165c04e2aa4c3c071296df4f0/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:03.750178 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1464d0-aef9-4c5c-a673-04ee08046d6a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.760893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1464d0-aef9-4c5c-a673-04ee08046d6a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.779523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:03.821003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd9060-eeb5-4817-9013-704254942fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.821639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9060-eeb5-4817-9013-704254942fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.821912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9060-eeb5-4817-9013-704254942fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.822182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9060-eeb5-4817-9013-704254942fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.822821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd9060-eeb5-4817-9013-704254942fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.824481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd9060-eeb5-4817-9013-704254942fc6 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.834427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1061/2104] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:18:03.838828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d4ec5-8ce7-4fcd-afdb-674b1fe3103e admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:03.845710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:03.849935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d4ec5-8ce7-4fcd-afdb-674b1fe3103e admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:03.855323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9569e-4ed0-41e3-bb75-b2ea84846e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:03.856009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9569e-4ed0-41e3-bb75-b2ea84846e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.856507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9569e-4ed0-41e3-bb75-b2ea84846e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.857162 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9569e-4ed0-41e3-bb75-b2ea84846e0b admin admin] PATH_INFO: `/v3/projects/7bcfc17ec65147cd949b51e9d9681cd0/users/dd1764c165c04e2aa4c3c071296df4f0/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.859508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9569e-4ed0-41e3-bb75-b2ea84846e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bcfc17ec65147cd949b51e9d9681cd0, user_id=dd1764c165c04e2aa4c3c071296df4f0, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:03.863168 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9569e-4ed0-41e3-bb75-b2ea84846e0b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:03.874734 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1044/2105] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:03 2022] PUT /identity/v3/projects/7bcfc17ec65147cd949b51e9d9681cd0/users/dd1764c165c04e2aa4c3c071296df4f0/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:03.887301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b6ff-83b1-4ff6-9ec7-2212fb4fc2d5 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:03.887591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b6ff-83b1-4ff6-9ec7-2212fb4fc2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:03.887901 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b6ff-83b1-4ff6-9ec7-2212fb4fc2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:03.916077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a3d5b6ff-83b1-4ff6-9ec7-2212fb4fc2d5 None None] MFA Rules not processed for user `dd1764c165c04e2aa4c3c071296df4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:03.917320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a3d5b6ff-83b1-4ff6-9ec7-2212fb4fc2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:03.986158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1062/2106] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:03.999404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9569e-4ed0-41e3-bb75-b2ea84846e0b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:04.001218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-72f9569e-4ed0-41e3-bb75-b2ea84846e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:04.060717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9569e-4ed0-41e3-bb75-b2ea84846e0b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:04.064368 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13684f-b3f1-4cfd-8203-e19a09c49127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:04.064955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13684f-b3f1-4cfd-8203-e19a09c49127 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:04.065230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13684f-b3f1-4cfd-8203-e19a09c49127 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:04.065498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13684f-b3f1-4cfd-8203-e19a09c49127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:04.074811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13684f-b3f1-4cfd-8203-e19a09c49127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:04.076324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13684f-b3f1-4cfd-8203-e19a09c49127 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:04.086703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1045/2107] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:04.115310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b6ff-83b1-4ff6-9ec7-2212fb4fc2d5 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:04.177126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b6ff-83b1-4ff6-9ec7-2212fb4fc2d5 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:04.181834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:04.182460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:04.182739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:04.183010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] PATH_INFO: `/v3/users/15b205db2c4b4bf59e26a52aa09d556f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:04.184170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b205db2c4b4bf59e26a52aa09d556f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:04.186166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:04.241281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:04.243343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b205db2c4b4bf59e26a52aa09d556f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.251261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b205db2c4b4bf59e26a52aa09d556f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.251959 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b205db2c4b4bf59e26a52aa09d556f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.264346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b205db2c4b4bf59e26a52aa09d556f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.265008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b205db2c4b4bf59e26a52aa09d556f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.279561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1063/2108] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:04 2022] DELETE /identity/v3/users/15b205db2c4b4bf59e26a52aa09d556f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:04.284398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f820ce3-66e4-4960-bee9-50c45d66e3cf None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:04.284681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f820ce3-66e4-4960-bee9-50c45d66e3cf None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:04.284954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f820ce3-66e4-4960-bee9-50c45d66e3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:04.303711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4f820ce3-66e4-4960-bee9-50c45d66e3cf None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:04.304935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4f820ce3-66e4-4960-bee9-50c45d66e3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:04.366048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1046/2109] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:04.376152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:04.377625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:04.436919 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e284e-4a22-464e-9297-87d63fc15f87 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:04.441103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4065c9-0f2e-4a85-a5f5-c13ace895598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:04.441695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4065c9-0f2e-4a85-a5f5-c13ace895598 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:04.441972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4065c9-0f2e-4a85-a5f5-c13ace895598 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:04.442243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4065c9-0f2e-4a85-a5f5-c13ace895598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:04.452322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4065c9-0f2e-4a85-a5f5-c13ace895598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:04.453764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4065c9-0f2e-4a85-a5f5-c13ace895598 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:04.463186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1064/2110] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:04.736467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f820ce3-66e4-4960-bee9-50c45d66e3cf None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:04.738110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4f820ce3-66e4-4960-bee9-50c45d66e3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:04.753364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f820ce3-66e4-4960-bee9-50c45d66e3cf None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:04.759791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:04.760465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:04.760814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:04.761000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] PATH_INFO: `/v3/projects/53436d261a754d3ba87af50a9e178677` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:04.762159 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=53436d261a754d3ba87af50a9e178677)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:04.764061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:04.813817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53436d261a754d3ba87af50a9e178677', 'request_id': 'req-1a780036-7a6f-4f94-84db-d0f80d2651ad'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.822893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53436d261a754d3ba87af50a9e178677', 'request_id': 'req-1a780036-7a6f-4f94-84db-d0f80d2651ad'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.833784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53436d261a754d3ba87af50a9e178677', 'request_id': 'req-1a780036-7a6f-4f94-84db-d0f80d2651ad'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.845123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] The token cache is being invalidate because project 53436d261a754d3ba87af50a9e178677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:04.845416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.846140 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.847731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1047/2111] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:04 2022] DELETE /identity/v3/projects/53436d261a754d3ba87af50a9e178677 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:04.851921 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4065c9-0f2e-4a85-a5f5-c13ace895598 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:04.862447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4065c9-0f2e-4a85-a5f5-c13ace895598 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:04.918779 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:04.919310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:04.919585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:04.919895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] PATH_INFO: `/v3/users/dd1764c165c04e2aa4c3c071296df4f0` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:04.921031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1764c165c04e2aa4c3c071296df4f0)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:04.922962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:04.970735 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1764c165c04e2aa4c3c071296df4f0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.977564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1764c165c04e2aa4c3c071296df4f0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.978270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1764c165c04e2aa4c3c071296df4f0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.986377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:04.991264 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1764c165c04e2aa4c3c071296df4f0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:04.992118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a271683a-3aec-4fc4-ad3e-6052a3bd2048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1764c165c04e2aa4c3c071296df4f0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:05.007311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1065/2112] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:04 2022] DELETE /identity/v3/users/dd1764c165c04e2aa4c3c071296df4f0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:05.279284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:05.281097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:05.294847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a780036-7a6f-4f94-84db-d0f80d2651ad admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:05.308331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:05.351772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:05.352457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:05.352733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:05.352996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] PATH_INFO: `/v3/projects/7bcfc17ec65147cd949b51e9d9681cd0` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:05.354147 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bcfc17ec65147cd949b51e9d9681cd0)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:05.356122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:05.403677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bcfc17ec65147cd949b51e9d9681cd0', 'request_id': 'req-841129a5-b25b-4466-9356-c0d87651b6cb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:05.411880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bcfc17ec65147cd949b51e9d9681cd0', 'request_id': 'req-841129a5-b25b-4466-9356-c0d87651b6cb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:05.418305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bcfc17ec65147cd949b51e9d9681cd0', 'request_id': 'req-841129a5-b25b-4466-9356-c0d87651b6cb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:05.428484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] The token cache is being invalidate because project 7bcfc17ec65147cd949b51e9d9681cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:05.428764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:05.429422 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-841129a5-b25b-4466-9356-c0d87651b6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:05.430910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1048/2113] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:05 2022] DELETE /identity/v3/projects/7bcfc17ec65147cd949b51e9d9681cd0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:05.436166 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f46da0-592f-4fb5-8d82-47b4e8014198 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:05.436662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f46da0-592f-4fb5-8d82-47b4e8014198 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:05.436776 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f46da0-592f-4fb5-8d82-47b4e8014198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:05.457338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c7f46da0-592f-4fb5-8d82-47b4e8014198 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:05.458479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c7f46da0-592f-4fb5-8d82-47b4e8014198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:05.518418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1066/2114] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:05.526531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41554ee-d606-477f-85a8-44cd450dba46 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:05.526892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41554ee-d606-477f-85a8-44cd450dba46 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:05.527281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41554ee-d606-477f-85a8-44cd450dba46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:05.548333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a41554ee-d606-477f-85a8-44cd450dba46 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:05.549556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a41554ee-d606-477f-85a8-44cd450dba46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:05.558156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1049/2115] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:05.562576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f46da0-592f-4fb5-8d82-47b4e8014198 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:05.572451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f46da0-592f-4fb5-8d82-47b4e8014198 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:05.577253 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5b1a0-252f-4dd7-9ce7-d2b3861cbbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:05.577853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5b1a0-252f-4dd7-9ce7-d2b3861cbbca admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:05.578130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5b1a0-252f-4dd7-9ce7-d2b3861cbbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:05.578399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5b1a0-252f-4dd7-9ce7-d2b3861cbbca admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:05.579053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5b1a0-252f-4dd7-9ce7-d2b3861cbbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:05.579367 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5b1a0-252f-4dd7-9ce7-d2b3861cbbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:05.580999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5b1a0-252f-4dd7-9ce7-d2b3861cbbca admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:05.592496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1067/2116] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:05.596859 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41554ee-d606-477f-85a8-44cd450dba46 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:05.606586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41554ee-d606-477f-85a8-44cd450dba46 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:05.612706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23f1dc-5582-43c9-b765-d2a062ecba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:05.613386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f1dc-5582-43c9-b765-d2a062ecba85 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:05.613663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f1dc-5582-43c9-b765-d2a062ecba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:05.613945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f1dc-5582-43c9-b765-d2a062ecba85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:05.614572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23f1dc-5582-43c9-b765-d2a062ecba85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:05.616650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23f1dc-5582-43c9-b765-d2a062ecba85 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:05.644599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1050/2117] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:05 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:05.648733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5b1a0-252f-4dd7-9ce7-d2b3861cbbca admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:05.658515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5b1a0-252f-4dd7-9ce7-d2b3861cbbca admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:05.714390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8b75d-9077-4999-9c99-df34ec8853ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:05.714956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8b75d-9077-4999-9c99-df34ec8853ae admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:05.715241 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8b75d-9077-4999-9c99-df34ec8853ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:05.715517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8b75d-9077-4999-9c99-df34ec8853ae admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:05.716153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8b75d-9077-4999-9c99-df34ec8853ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:05.718118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8b75d-9077-4999-9c99-df34ec8853ae admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:05.745669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1068/2118] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:05 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:05.749816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23f1dc-5582-43c9-b765-d2a062ecba85 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:05.760311 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23f1dc-5582-43c9-b765-d2a062ecba85 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:05.765179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b6ce-9d15-4e6b-9612-9e124205097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:05.765779 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b6ce-9d15-4e6b-9612-9e124205097c admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:05.766059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b6ce-9d15-4e6b-9612-9e124205097c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:05.766326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b6ce-9d15-4e6b-9612-9e124205097c admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:05.766967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b6ce-9d15-4e6b-9612-9e124205097c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:05.768594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b6ce-9d15-4e6b-9612-9e124205097c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:05.778555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1051/2119] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:05.782495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8b75d-9077-4999-9c99-df34ec8853ae admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:05.792947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8b75d-9077-4999-9c99-df34ec8853ae admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:05.798074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0b707-e8c8-4683-a870-6bf4bbb76b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:05.798679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0b707-e8c8-4683-a870-6bf4bbb76b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:05.798956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0b707-e8c8-4683-a870-6bf4bbb76b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:05.799231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0b707-e8c8-4683-a870-6bf4bbb76b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:05.799879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0b707-e8c8-4683-a870-6bf4bbb76b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:05.801524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0b707-e8c8-4683-a870-6bf4bbb76b70 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:05.812433 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1069/2120] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:05.816635 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b6ce-9d15-4e6b-9612-9e124205097c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:05.827002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b6ce-9d15-4e6b-9612-9e124205097c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:05.832080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3f6be-434d-43de-8dac-b666aad5b6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:05.832756 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3f6be-434d-43de-8dac-b666aad5b6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:05.833010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3f6be-434d-43de-8dac-b666aad5b6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:05.833309 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3f6be-434d-43de-8dac-b666aad5b6a4 admin admin] PATH_INFO: `/v3/projects/3eeaf3ff85334abbb8353600767e0c57/users/ea7f164b13c04972bc6b8ff5db420bdf/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:05.852033 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3f6be-434d-43de-8dac-b666aad5b6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eeaf3ff85334abbb8353600767e0c57, user_id=ea7f164b13c04972bc6b8ff5db420bdf, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:05.854867 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3f6be-434d-43de-8dac-b666aad5b6a4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:05.878981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1052/2121] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:05 2022] PUT /identity/v3/projects/3eeaf3ff85334abbb8353600767e0c57/users/ea7f164b13c04972bc6b8ff5db420bdf/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:18:05.889984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e842c-4c54-4ae6-967b-99f6518b3320 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:05.890290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e842c-4c54-4ae6-967b-99f6518b3320 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:05.890559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e842c-4c54-4ae6-967b-99f6518b3320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:05.919698 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9c7e842c-4c54-4ae6-967b-99f6518b3320 None None] MFA Rules not processed for user `ea7f164b13c04972bc6b8ff5db420bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:05.920928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9c7e842c-4c54-4ae6-967b-99f6518b3320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:05.959737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:05.985696 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1070/2122] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:05.990506 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3f6be-434d-43de-8dac-b666aad5b6a4 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:06.037614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:06.063078 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3f6be-434d-43de-8dac-b666aad5b6a4 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:06.068522 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7e72-3c8b-4eb9-b7df-4d8da7530294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:06.069131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7e72-3c8b-4eb9-b7df-4d8da7530294 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:06.069416 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7e72-3c8b-4eb9-b7df-4d8da7530294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:06.069685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7e72-3c8b-4eb9-b7df-4d8da7530294 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:06.070316 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c7e72-3c8b-4eb9-b7df-4d8da7530294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:06.072243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c7e72-3c8b-4eb9-b7df-4d8da7530294 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:06.101583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1053/2123] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:05 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:06.106022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e842c-4c54-4ae6-967b-99f6518b3320 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:06.117315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e842c-4c54-4ae6-967b-99f6518b3320 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:06.174753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518d1e-7ce0-44ec-8a56-5cc97d5e5f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:06.175370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518d1e-7ce0-44ec-8a56-5cc97d5e5f04 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:06.175649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518d1e-7ce0-44ec-8a56-5cc97d5e5f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:06.175922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518d1e-7ce0-44ec-8a56-5cc97d5e5f04 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:06.176580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31518d1e-7ce0-44ec-8a56-5cc97d5e5f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:06.178545 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31518d1e-7ce0-44ec-8a56-5cc97d5e5f04 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:06.208643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1071/2124] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:06 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:06.212800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7e72-3c8b-4eb9-b7df-4d8da7530294 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:06.223016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7e72-3c8b-4eb9-b7df-4d8da7530294 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:06.227726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a3ada-5353-4a05-861b-cb32c1128656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:06.228353 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3ada-5353-4a05-861b-cb32c1128656 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:06.228633 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3ada-5353-4a05-861b-cb32c1128656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:06.228904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3ada-5353-4a05-861b-cb32c1128656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:06.229580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a3ada-5353-4a05-861b-cb32c1128656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:06.231248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a3ada-5353-4a05-861b-cb32c1128656 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:06.242341 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1054/2125] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:06.246567 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518d1e-7ce0-44ec-8a56-5cc97d5e5f04 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:06.256765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518d1e-7ce0-44ec-8a56-5cc97d5e5f04 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:06.262079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44ac5-64a4-4fb0-9eb2-24e2bcdb6f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:06.262724 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44ac5-64a4-4fb0-9eb2-24e2bcdb6f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:06.262997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44ac5-64a4-4fb0-9eb2-24e2bcdb6f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:06.263271 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44ac5-64a4-4fb0-9eb2-24e2bcdb6f48 admin admin] PATH_INFO: `/v3/projects/2f20aea35c344474b3c9c99d24919c62/users/0ff8608401b54aef87a645f0ba3eb3ae/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:06.278018 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e44ac5-64a4-4fb0-9eb2-24e2bcdb6f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f20aea35c344474b3c9c99d24919c62, user_id=0ff8608401b54aef87a645f0ba3eb3ae, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:06.281277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e44ac5-64a4-4fb0-9eb2-24e2bcdb6f48 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:06.295731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1072/2126] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:06 2022] PUT /identity/v3/projects/2f20aea35c344474b3c9c99d24919c62/users/0ff8608401b54aef87a645f0ba3eb3ae/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:06.299953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a3ada-5353-4a05-861b-cb32c1128656 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:06.310398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a3ada-5353-4a05-861b-cb32c1128656 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:06.368583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf525c-9463-4ab7-9770-abd4ea0d07a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:06.369187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf525c-9463-4ab7-9770-abd4ea0d07a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:06.369475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf525c-9463-4ab7-9770-abd4ea0d07a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:06.369748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf525c-9463-4ab7-9770-abd4ea0d07a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:06.370372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf525c-9463-4ab7-9770-abd4ea0d07a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:06.371968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf525c-9463-4ab7-9770-abd4ea0d07a6 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:06.382272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1055/2127] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:06.386621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44ac5-64a4-4fb0-9eb2-24e2bcdb6f48 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:06.396798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44ac5-64a4-4fb0-9eb2-24e2bcdb6f48 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:06.401918 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868f052-322f-445e-8332-37b2856f9202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:06.402593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f052-322f-445e-8332-37b2856f9202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:06.402889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f052-322f-445e-8332-37b2856f9202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:06.403125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f052-322f-445e-8332-37b2856f9202 admin admin] PATH_INFO: `/v3/projects/2f20aea35c344474b3c9c99d24919c62/users/0ff8608401b54aef87a645f0ba3eb3ae/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:06.405240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868f052-322f-445e-8332-37b2856f9202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f20aea35c344474b3c9c99d24919c62, user_id=0ff8608401b54aef87a645f0ba3eb3ae, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:06.407909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868f052-322f-445e-8332-37b2856f9202 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:06.418865 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1073/2128] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:06 2022] PUT /identity/v3/projects/2f20aea35c344474b3c9c99d24919c62/users/0ff8608401b54aef87a645f0ba3eb3ae/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:06.430208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc41f5-9df7-4173-8335-3c3acc09e2c2 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:06.430495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc41f5-9df7-4173-8335-3c3acc09e2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:06.430772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc41f5-9df7-4173-8335-3c3acc09e2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:06.458257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-18fc41f5-9df7-4173-8335-3c3acc09e2c2 None None] MFA Rules not processed for user `0ff8608401b54aef87a645f0ba3eb3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:06.459460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-18fc41f5-9df7-4173-8335-3c3acc09e2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:06.527787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1056/2129] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:06.539241 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868f052-322f-445e-8332-37b2856f9202 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:06.541319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2868f052-322f-445e-8332-37b2856f9202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:06.606347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868f052-322f-445e-8332-37b2856f9202 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:06.610452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4331e2-a0bb-4af3-b8cc-2e211467f1af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:06.611364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4331e2-a0bb-4af3-b8cc-2e211467f1af service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:06.611634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4331e2-a0bb-4af3-b8cc-2e211467f1af service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:06.611905 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4331e2-a0bb-4af3-b8cc-2e211467f1af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:06.621376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4331e2-a0bb-4af3-b8cc-2e211467f1af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:06.622798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4331e2-a0bb-4af3-b8cc-2e211467f1af service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:06.632265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1074/2130] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:06.704919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc41f5-9df7-4173-8335-3c3acc09e2c2 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:06.751178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:06.772408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc41f5-9df7-4173-8335-3c3acc09e2c2 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:06.778153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:06.778749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:06.779022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:06.779287 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] PATH_INFO: `/v3/users/ea7f164b13c04972bc6b8ff5db420bdf` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:06.780564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7f164b13c04972bc6b8ff5db420bdf)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:06.782519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:06.832677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7f164b13c04972bc6b8ff5db420bdf'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:06.840091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7f164b13c04972bc6b8ff5db420bdf'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:06.852938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7f164b13c04972bc6b8ff5db420bdf'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:06.853651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7f164b13c04972bc6b8ff5db420bdf'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:06.854281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7f164b13c04972bc6b8ff5db420bdf'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:06.869914 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1057/2131] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:06 2022] DELETE /identity/v3/users/ea7f164b13c04972bc6b8ff5db420bdf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:06.874764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaefa8d-1e35-487a-96d4-46e51cbedda2 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:06.875056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaefa8d-1e35-487a-96d4-46e51cbedda2 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:06.875337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaefa8d-1e35-487a-96d4-46e51cbedda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:06.894528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-dbaefa8d-1e35-487a-96d4-46e51cbedda2 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:06.895766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-dbaefa8d-1e35-487a-96d4-46e51cbedda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:06.925914 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:06.954746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1075/2132] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:06.964805 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:06.966191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:07.025719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada118c-aafe-4390-8956-72a9f8790d9f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:07.029344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41a259-76a0-46c2-afc6-a4bad64750da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:07.029947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a259-76a0-46c2-afc6-a4bad64750da service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:07.030223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a259-76a0-46c2-afc6-a4bad64750da service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:07.030491 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a259-76a0-46c2-afc6-a4bad64750da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:07.039760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41a259-76a0-46c2-afc6-a4bad64750da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:07.041221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41a259-76a0-46c2-afc6-a4bad64750da service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:07.051011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1058/2133] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:07.334515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaefa8d-1e35-487a-96d4-46e51cbedda2 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:07.335934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-dbaefa8d-1e35-487a-96d4-46e51cbedda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:07.348011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaefa8d-1e35-487a-96d4-46e51cbedda2 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:07.353281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:07.353796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:07.354077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:07.354351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] PATH_INFO: `/v3/projects/3eeaf3ff85334abbb8353600767e0c57` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:07.355649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eeaf3ff85334abbb8353600767e0c57)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:07.357633 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:07.407090 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eeaf3ff85334abbb8353600767e0c57', 'request_id': 'req-51326bc6-4166-4055-9469-9b7b6147a93c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.412414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eeaf3ff85334abbb8353600767e0c57', 'request_id': 'req-51326bc6-4166-4055-9469-9b7b6147a93c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.418671 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eeaf3ff85334abbb8353600767e0c57', 'request_id': 'req-51326bc6-4166-4055-9469-9b7b6147a93c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.432842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] The token cache is being invalidate because project 3eeaf3ff85334abbb8353600767e0c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:07.433203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.433849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.435648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1076/2134] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:07 2022] DELETE /identity/v3/projects/3eeaf3ff85334abbb8353600767e0c57 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:07.439412 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41a259-76a0-46c2-afc6-a4bad64750da service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:07.448998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41a259-76a0-46c2-afc6-a4bad64750da service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:07.503922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:07.504561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:07.504838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:07.505107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] PATH_INFO: `/v3/users/0ff8608401b54aef87a645f0ba3eb3ae` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:07.506226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff8608401b54aef87a645f0ba3eb3ae)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:07.508142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:07.510407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:07.556875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff8608401b54aef87a645f0ba3eb3ae'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.563720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff8608401b54aef87a645f0ba3eb3ae'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.577731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff8608401b54aef87a645f0ba3eb3ae'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.578435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff8608401b54aef87a645f0ba3eb3ae'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.579072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-324d95a2-50fc-4a36-b590-01ae58de0b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff8608401b54aef87a645f0ba3eb3ae'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.593545 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1059/2135] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:07 2022] DELETE /identity/v3/users/0ff8608401b54aef87a645f0ba3eb3ae => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:07.862980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:07.864491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:07.878404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326bc6-4166-4055-9469-9b7b6147a93c admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:07.938168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:07.938796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:07.939074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:07.939346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] PATH_INFO: `/v3/projects/2f20aea35c344474b3c9c99d24919c62` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:07.940539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f20aea35c344474b3c9c99d24919c62)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:07.942480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:07.990177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f20aea35c344474b3c9c99d24919c62', 'request_id': 'req-175f3c11-0713-493a-9363-a691104cd63b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.996098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f20aea35c344474b3c9c99d24919c62', 'request_id': 'req-175f3c11-0713-493a-9363-a691104cd63b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:07.998066 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:08.003397 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f20aea35c344474b3c9c99d24919c62', 'request_id': 'req-175f3c11-0713-493a-9363-a691104cd63b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:08.017400 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] The token cache is being invalidate because project 2f20aea35c344474b3c9c99d24919c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:08.017683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:08.018305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-175f3c11-0713-493a-9363-a691104cd63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:08.019787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1077/2136] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:07 2022] DELETE /identity/v3/projects/2f20aea35c344474b3c9c99d24919c62 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:08.024822 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebb972-2e6b-4931-8cd7-780d094f439d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.025109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebb972-2e6b-4931-8cd7-780d094f439d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.025385 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebb972-2e6b-4931-8cd7-780d094f439d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.046177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f0ebb972-2e6b-4931-8cd7-780d094f439d None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:08.047436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f0ebb972-2e6b-4931-8cd7-780d094f439d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:08.111821 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1060/2137] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:08.119692 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e9717-148d-412d-99e0-ab82d8bfdb46 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.119992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e9717-148d-412d-99e0-ab82d8bfdb46 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.120267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e9717-148d-412d-99e0-ab82d8bfdb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.140775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b59e9717-148d-412d-99e0-ab82d8bfdb46 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:08.142002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b59e9717-148d-412d-99e0-ab82d8bfdb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:08.150240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1078/2138] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:08.155066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebb972-2e6b-4931-8cd7-780d094f439d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.166117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebb972-2e6b-4931-8cd7-780d094f439d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:08.171061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c911be2-1348-49ba-bcad-fa10b6eeef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:08.171691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c911be2-1348-49ba-bcad-fa10b6eeef11 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.171968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c911be2-1348-49ba-bcad-fa10b6eeef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.172237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c911be2-1348-49ba-bcad-fa10b6eeef11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.172918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c911be2-1348-49ba-bcad-fa10b6eeef11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:08.173359 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c911be2-1348-49ba-bcad-fa10b6eeef11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:08.175005 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c911be2-1348-49ba-bcad-fa10b6eeef11 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:08.187184 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1061/2139] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:08.191845 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e9717-148d-412d-99e0-ab82d8bfdb46 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.202461 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e9717-148d-412d-99e0-ab82d8bfdb46 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:08.209104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc59a2-67f6-4c33-b421-982257ecdd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:08.209726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc59a2-67f6-4c33-b421-982257ecdd4f admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.210003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc59a2-67f6-4c33-b421-982257ecdd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.210274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc59a2-67f6-4c33-b421-982257ecdd4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.210937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc59a2-67f6-4c33-b421-982257ecdd4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:08.213081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc59a2-67f6-4c33-b421-982257ecdd4f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:08.244351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1079/2140] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:08 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:08.248814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c911be2-1348-49ba-bcad-fa10b6eeef11 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.259069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c911be2-1348-49ba-bcad-fa10b6eeef11 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:08.321244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e69af2-918e-4a56-a90e-7913517004a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:08.321888 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e69af2-918e-4a56-a90e-7913517004a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.322172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e69af2-918e-4a56-a90e-7913517004a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.322443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e69af2-918e-4a56-a90e-7913517004a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.323121 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e69af2-918e-4a56-a90e-7913517004a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:08.325220 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e69af2-918e-4a56-a90e-7913517004a4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:08.342680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:08.349501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1062/2141] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:08 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:08.353318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc59a2-67f6-4c33-b421-982257ecdd4f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.373587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc59a2-67f6-4c33-b421-982257ecdd4f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:08.378208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a7fe4-8f66-4cf0-8ab6-be32bef044f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:08.378815 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a7fe4-8f66-4cf0-8ab6-be32bef044f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.379132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a7fe4-8f66-4cf0-8ab6-be32bef044f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.379597 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a7fe4-8f66-4cf0-8ab6-be32bef044f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.380271 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a7fe4-8f66-4cf0-8ab6-be32bef044f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:08.381929 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a7fe4-8f66-4cf0-8ab6-be32bef044f1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:08.392691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1080/2142] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:08.399037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e69af2-918e-4a56-a90e-7913517004a4 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.415571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e69af2-918e-4a56-a90e-7913517004a4 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:08.422792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201e1f-a4bd-49f2-acbc-913f24af1c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:08.423744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201e1f-a4bd-49f2-acbc-913f24af1c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.424221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201e1f-a4bd-49f2-acbc-913f24af1c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.424746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201e1f-a4bd-49f2-acbc-913f24af1c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.425869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201e1f-a4bd-49f2-acbc-913f24af1c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:08.428823 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201e1f-a4bd-49f2-acbc-913f24af1c82 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:08.446584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1063/2143] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:08.452883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a7fe4-8f66-4cf0-8ab6-be32bef044f1 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.464995 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a7fe4-8f66-4cf0-8ab6-be32bef044f1 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:08.470701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe947d5-59ba-4cdf-89de-e8f22bcbded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:08.471382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe947d5-59ba-4cdf-89de-e8f22bcbded5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.471641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe947d5-59ba-4cdf-89de-e8f22bcbded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.471911 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe947d5-59ba-4cdf-89de-e8f22bcbded5 admin admin] PATH_INFO: `/v3/projects/547fd71999dd407a818e1d168662a486/users/0602c7cb51b34559b34d830f47f49af8/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.487697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe947d5-59ba-4cdf-89de-e8f22bcbded5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=547fd71999dd407a818e1d168662a486, user_id=0602c7cb51b34559b34d830f47f49af8, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:08.490528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe947d5-59ba-4cdf-89de-e8f22bcbded5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:08.506285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1081/2144] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:08 2022] PUT /identity/v3/projects/547fd71999dd407a818e1d168662a486/users/0602c7cb51b34559b34d830f47f49af8/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:08.518707 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6839e-3c2b-4311-8ce6-9fc47c0482ab None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.519010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6839e-3c2b-4311-8ce6-9fc47c0482ab None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.519253 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6839e-3c2b-4311-8ce6-9fc47c0482ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.551081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-fed6839e-3c2b-4311-8ce6-9fc47c0482ab None None] MFA Rules not processed for user `0602c7cb51b34559b34d830f47f49af8`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:08.552365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fed6839e-3c2b-4311-8ce6-9fc47c0482ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:08.627259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1064/2145] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:08.632262 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe947d5-59ba-4cdf-89de-e8f22bcbded5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.696543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe947d5-59ba-4cdf-89de-e8f22bcbded5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:08.701473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0931b-aa42-4cd0-bb19-3e6d34a6ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:08.702074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0931b-aa42-4cd0-bb19-3e6d34a6ff44 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.702353 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0931b-aa42-4cd0-bb19-3e6d34a6ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.702615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0931b-aa42-4cd0-bb19-3e6d34a6ff44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.703285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0931b-aa42-4cd0-bb19-3e6d34a6ff44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:08.705230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0931b-aa42-4cd0-bb19-3e6d34a6ff44 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:08.735226 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1082/2146] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:08 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:08.739915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6839e-3c2b-4311-8ce6-9fc47c0482ab None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.751533 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6839e-3c2b-4311-8ce6-9fc47c0482ab None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:08.823260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514148b3-1f86-4df3-a4ff-4694fc2ad064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:08.824059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514148b3-1f86-4df3-a4ff-4694fc2ad064 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.824370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514148b3-1f86-4df3-a4ff-4694fc2ad064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.824771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514148b3-1f86-4df3-a4ff-4694fc2ad064 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.825332 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514148b3-1f86-4df3-a4ff-4694fc2ad064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:08.827705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514148b3-1f86-4df3-a4ff-4694fc2ad064 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:08.860348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1065/2147] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:08 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:08.863274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0931b-aa42-4cd0-bb19-3e6d34a6ff44 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.873995 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0931b-aa42-4cd0-bb19-3e6d34a6ff44 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:08.878826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02fdb3-5a6b-4ca9-8305-6f4ba344ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:08.879357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02fdb3-5a6b-4ca9-8305-6f4ba344ebb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.879861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02fdb3-5a6b-4ca9-8305-6f4ba344ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.880122 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02fdb3-5a6b-4ca9-8305-6f4ba344ebb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.880801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02fdb3-5a6b-4ca9-8305-6f4ba344ebb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:08.882475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02fdb3-5a6b-4ca9-8305-6f4ba344ebb5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:08.894628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1083/2148] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:08.899013 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514148b3-1f86-4df3-a4ff-4694fc2ad064 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.909616 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514148b3-1f86-4df3-a4ff-4694fc2ad064 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:08.914681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e75b7-2d45-46cc-81d2-3d34b8358a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:08.915323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e75b7-2d45-46cc-81d2-3d34b8358a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:08.915598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e75b7-2d45-46cc-81d2-3d34b8358a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:08.915896 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e75b7-2d45-46cc-81d2-3d34b8358a6b admin admin] PATH_INFO: `/v3/projects/732ac04deba54ea99ce44ab3bd605e9b/users/525fa867c4494e7ab5dd449574150bc9/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:08.933023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e75b7-2d45-46cc-81d2-3d34b8358a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=732ac04deba54ea99ce44ab3bd605e9b, user_id=525fa867c4494e7ab5dd449574150bc9, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:08.935713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e75b7-2d45-46cc-81d2-3d34b8358a6b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:08.951123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1066/2149] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:08 2022] PUT /identity/v3/projects/732ac04deba54ea99ce44ab3bd605e9b/users/525fa867c4494e7ab5dd449574150bc9/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:08.955230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02fdb3-5a6b-4ca9-8305-6f4ba344ebb5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:08.966036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02fdb3-5a6b-4ca9-8305-6f4ba344ebb5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:09.025847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45479bb3-961d-4d83-ac27-96ee5e271507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:09.026499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45479bb3-961d-4d83-ac27-96ee5e271507 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:09.027032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45479bb3-961d-4d83-ac27-96ee5e271507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:09.027314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45479bb3-961d-4d83-ac27-96ee5e271507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:09.028043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45479bb3-961d-4d83-ac27-96ee5e271507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:09.029887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45479bb3-961d-4d83-ac27-96ee5e271507 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:09.031254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:09.042979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1084/2150] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:09.047100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e75b7-2d45-46cc-81d2-3d34b8358a6b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:09.057723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e75b7-2d45-46cc-81d2-3d34b8358a6b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:09.063300 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fea25-d940-4cfd-9425-5a195a3fc45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:09.064130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fea25-d940-4cfd-9425-5a195a3fc45f admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:09.064468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fea25-d940-4cfd-9425-5a195a3fc45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:09.064746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fea25-d940-4cfd-9425-5a195a3fc45f admin admin] PATH_INFO: `/v3/projects/732ac04deba54ea99ce44ab3bd605e9b/users/525fa867c4494e7ab5dd449574150bc9/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:09.067167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fea25-d940-4cfd-9425-5a195a3fc45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=732ac04deba54ea99ce44ab3bd605e9b, user_id=525fa867c4494e7ab5dd449574150bc9, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:09.070056 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fea25-d940-4cfd-9425-5a195a3fc45f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:09.081738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1067/2151] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:09 2022] PUT /identity/v3/projects/732ac04deba54ea99ce44ab3bd605e9b/users/525fa867c4494e7ab5dd449574150bc9/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:18:09.092206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52606-c2ca-4268-906c-0a226421edc8 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:09.092530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52606-c2ca-4268-906c-0a226421edc8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:09.092806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52606-c2ca-4268-906c-0a226421edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:09.122984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b8b52606-c2ca-4268-906c-0a226421edc8 None None] MFA Rules not processed for user `525fa867c4494e7ab5dd449574150bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:09.124285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b8b52606-c2ca-4268-906c-0a226421edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:09.194714 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1085/2152] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:09.205739 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fea25-d940-4cfd-9425-5a195a3fc45f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:09.207576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4a2fea25-d940-4cfd-9425-5a195a3fc45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:09.244129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:09.273138 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fea25-d940-4cfd-9425-5a195a3fc45f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:09.277145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f366c8-edbb-4d66-9ae0-f599cf79f849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:09.277700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f366c8-edbb-4d66-9ae0-f599cf79f849 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:09.277978 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f366c8-edbb-4d66-9ae0-f599cf79f849 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:09.278300 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f366c8-edbb-4d66-9ae0-f599cf79f849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:09.288282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f366c8-edbb-4d66-9ae0-f599cf79f849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:09.289744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f366c8-edbb-4d66-9ae0-f599cf79f849 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:09.299322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1068/2153] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:09.857805 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b52606-c2ca-4268-906c-0a226421edc8 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:09.924055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b52606-c2ca-4268-906c-0a226421edc8 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:09.928708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:09.929341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:09.929619 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:09.929888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] PATH_INFO: `/v3/users/0602c7cb51b34559b34d830f47f49af8` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:09.930998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0602c7cb51b34559b34d830f47f49af8)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:09.933049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:09.981194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0602c7cb51b34559b34d830f47f49af8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:09.988975 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0602c7cb51b34559b34d830f47f49af8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:09.989645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0602c7cb51b34559b34d830f47f49af8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.001738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0602c7cb51b34559b34d830f47f49af8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.002379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0602c7cb51b34559b34d830f47f49af8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.011350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:10.016230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1086/2154] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:09 2022] DELETE /identity/v3/users/0602c7cb51b34559b34d830f47f49af8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:10.020971 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2418d3-7b2f-4539-9e3c-d6228b87cd0a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:10.021462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2418d3-7b2f-4539-9e3c-d6228b87cd0a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:10.021659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2418d3-7b2f-4539-9e3c-d6228b87cd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:10.040956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3c2418d3-7b2f-4539-9e3c-d6228b87cd0a None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:10.042188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3c2418d3-7b2f-4539-9e3c-d6228b87cd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:10.100672 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1069/2155] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:10.111290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:10.112850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:10.173666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e944ef-07d1-4756-98f8-23a31291a6ef admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:10.179871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73a3c2-7e96-41e2-b3a6-12cfdcdb5373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:10.180651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a3c2-7e96-41e2-b3a6-12cfdcdb5373 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:10.180926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a3c2-7e96-41e2-b3a6-12cfdcdb5373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:10.181246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a3c2-7e96-41e2-b3a6-12cfdcdb5373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:10.191709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73a3c2-7e96-41e2-b3a6-12cfdcdb5373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:10.193177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73a3c2-7e96-41e2-b3a6-12cfdcdb5373 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:10.205171 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1087/2156] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:10.490147 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2418d3-7b2f-4539-9e3c-d6228b87cd0a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:10.491848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3c2418d3-7b2f-4539-9e3c-d6228b87cd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:10.507669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2418d3-7b2f-4539-9e3c-d6228b87cd0a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:10.512455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:10.513098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:10.513370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:10.513637 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] PATH_INFO: `/v3/projects/547fd71999dd407a818e1d168662a486` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:10.514792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=547fd71999dd407a818e1d168662a486)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:10.516836 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:10.570638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547fd71999dd407a818e1d168662a486', 'request_id': 'req-da65aa8b-eb6e-49c4-acff-4963f5057e73'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.579815 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547fd71999dd407a818e1d168662a486', 'request_id': 'req-da65aa8b-eb6e-49c4-acff-4963f5057e73'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.586719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547fd71999dd407a818e1d168662a486', 'request_id': 'req-da65aa8b-eb6e-49c4-acff-4963f5057e73'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.597256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] The token cache is being invalidate because project 547fd71999dd407a818e1d168662a486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:10.597574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.598245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.599740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1070/2157] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:10 2022] DELETE /identity/v3/projects/547fd71999dd407a818e1d168662a486 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:10.604027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73a3c2-7e96-41e2-b3a6-12cfdcdb5373 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:10.614070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73a3c2-7e96-41e2-b3a6-12cfdcdb5373 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:10.672463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:10.673091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:10.673371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:10.673644 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] PATH_INFO: `/v3/users/525fa867c4494e7ab5dd449574150bc9` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:10.674841 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525fa867c4494e7ab5dd449574150bc9)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:10.676848 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:10.724089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525fa867c4494e7ab5dd449574150bc9'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.730958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525fa867c4494e7ab5dd449574150bc9'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.731665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525fa867c4494e7ab5dd449574150bc9'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.744258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525fa867c4494e7ab5dd449574150bc9'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.744963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525fa867c4494e7ab5dd449574150bc9'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:10.759362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1088/2158] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:10 2022] DELETE /identity/v3/users/525fa867c4494e7ab5dd449574150bc9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:11.283526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:11.290326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:11.291255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:11.293346 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:11.333298 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65aa8b-eb6e-49c4-acff-4963f5057e73 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:11.365576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:11.415470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:11.425494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:11.426498 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:11.427159 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:11.427543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] PATH_INFO: `/v3/projects/732ac04deba54ea99ce44ab3bd605e9b` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:11.428860 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] RBAC: Authorizing `identity:delete_project(project_id=732ac04deba54ea99ce44ab3bd605e9b)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:11.431069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:11.444197 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33217b8b-7f67-4788-a502-bfa23bce4f94 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:11.456938 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3a7b2-c52f-45fb-b7f3-fc1d95bf8e64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:11.457878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3a7b2-c52f-45fb-b7f3-fc1d95bf8e64 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:11.458211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3a7b2-c52f-45fb-b7f3-fc1d95bf8e64 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:11.458555 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3a7b2-c52f-45fb-b7f3-fc1d95bf8e64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:11.460876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-68b3a7b2-c52f-45fb-b7f3-fc1d95bf8e64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:11.499453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732ac04deba54ea99ce44ab3bd605e9b', 'request_id': 'req-5c924ce3-8592-4bb3-b2f6-961ff391323a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:11.509785 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732ac04deba54ea99ce44ab3bd605e9b', 'request_id': 'req-5c924ce3-8592-4bb3-b2f6-961ff391323a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:11.518978 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732ac04deba54ea99ce44ab3bd605e9b', 'request_id': 'req-5c924ce3-8592-4bb3-b2f6-961ff391323a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:11.544156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] The token cache is being invalidate because project 732ac04deba54ea99ce44ab3bd605e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:11.544555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:11.545178 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3a7b2-c52f-45fb-b7f3-fc1d95bf8e64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:11.545350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c924ce3-8592-4bb3-b2f6-961ff391323a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:11.546947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1071/2159] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:11 2022] DELETE /identity/v3/projects/732ac04deba54ea99ce44ab3bd605e9b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:11.547319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3a7b2-c52f-45fb-b7f3-fc1d95bf8e64 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:11.551551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075839d-bfe5-4cda-b3cb-a4ab49cbd775 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:11.551828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075839d-bfe5-4cda-b3cb-a4ab49cbd775 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:11.552095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075839d-bfe5-4cda-b3cb-a4ab49cbd775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:11.557365 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1089/2160] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:11.572851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1075839d-bfe5-4cda-b3cb-a4ab49cbd775 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:11.574105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1075839d-bfe5-4cda-b3cb-a4ab49cbd775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:11.640394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1072/2161] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:11.648191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047dff-82fe-43cc-9f69-ab1e095eac03 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:11.648663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047dff-82fe-43cc-9f69-ab1e095eac03 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:11.648988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047dff-82fe-43cc-9f69-ab1e095eac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:11.671447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-dc047dff-82fe-43cc-9f69-ab1e095eac03 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:11.672772 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-dc047dff-82fe-43cc-9f69-ab1e095eac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:11.680684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1090/2162] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:11.685169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075839d-bfe5-4cda-b3cb-a4ab49cbd775 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:11.695496 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075839d-bfe5-4cda-b3cb-a4ab49cbd775 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:11.700286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ce612-19b2-4af6-9de6-e7e369107ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:11.700924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ce612-19b2-4af6-9de6-e7e369107ebc admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:11.701318 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ce612-19b2-4af6-9de6-e7e369107ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:11.701591 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ce612-19b2-4af6-9de6-e7e369107ebc admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:11.702244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ce612-19b2-4af6-9de6-e7e369107ebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:11.702575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ce612-19b2-4af6-9de6-e7e369107ebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:11.704193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ce612-19b2-4af6-9de6-e7e369107ebc admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:11.716383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1073/2163] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:11.720716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047dff-82fe-43cc-9f69-ab1e095eac03 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:11.729888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047dff-82fe-43cc-9f69-ab1e095eac03 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:11.734716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89c29b-9400-47f2-8c1e-43970f9bc880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:11.735321 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89c29b-9400-47f2-8c1e-43970f9bc880 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:11.735587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89c29b-9400-47f2-8c1e-43970f9bc880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:11.736170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89c29b-9400-47f2-8c1e-43970f9bc880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:11.736868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89c29b-9400-47f2-8c1e-43970f9bc880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:11.738799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89c29b-9400-47f2-8c1e-43970f9bc880 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:11.767637 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1091/2164] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:11 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:11.771851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ce612-19b2-4af6-9de6-e7e369107ebc admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:11.782542 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ce612-19b2-4af6-9de6-e7e369107ebc admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:11.852306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736303ff-84d9-4a24-881f-4c86bd990d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:11.852944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736303ff-84d9-4a24-881f-4c86bd990d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:11.853348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736303ff-84d9-4a24-881f-4c86bd990d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:11.853622 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736303ff-84d9-4a24-881f-4c86bd990d04 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:11.854268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736303ff-84d9-4a24-881f-4c86bd990d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:11.856539 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736303ff-84d9-4a24-881f-4c86bd990d04 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:11.882934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1074/2165] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:11 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:11.887542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89c29b-9400-47f2-8c1e-43970f9bc880 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:11.899379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89c29b-9400-47f2-8c1e-43970f9bc880 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:11.904378 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5881f5-d174-4354-a7c3-cb66a63cb7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:11.905038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5881f5-d174-4354-a7c3-cb66a63cb7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:11.905442 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5881f5-d174-4354-a7c3-cb66a63cb7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:11.905606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5881f5-d174-4354-a7c3-cb66a63cb7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:11.906270 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5881f5-d174-4354-a7c3-cb66a63cb7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:11.907884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5881f5-d174-4354-a7c3-cb66a63cb7d3 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:11.921121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1092/2166] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:11.922441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736303ff-84d9-4a24-881f-4c86bd990d04 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:11.928459 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:11.935396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736303ff-84d9-4a24-881f-4c86bd990d04 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:11.941117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1562b1-c014-4a93-b528-4e9e7cd6d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:11.941763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1562b1-c014-4a93-b528-4e9e7cd6d7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:11.942111 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1562b1-c014-4a93-b528-4e9e7cd6d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:11.942382 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1562b1-c014-4a93-b528-4e9e7cd6d7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:11.943029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1562b1-c014-4a93-b528-4e9e7cd6d7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:11.944720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1562b1-c014-4a93-b528-4e9e7cd6d7d2 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:11.955574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1075/2167] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:18:11.960026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5881f5-d174-4354-a7c3-cb66a63cb7d3 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:11.969874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5881f5-d174-4354-a7c3-cb66a63cb7d3 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:11.974664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297f30a-04ab-4be2-b27d-75d80b0e6d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:11.975308 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297f30a-04ab-4be2-b27d-75d80b0e6d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:11.975583 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297f30a-04ab-4be2-b27d-75d80b0e6d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:11.975851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297f30a-04ab-4be2-b27d-75d80b0e6d60 admin admin] PATH_INFO: `/v3/projects/6c36f5cc9c864ecf825d772f48f87b78/users/e8f4daad02e44a8c9b9c42fa2e3fb2ad/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:11.991415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297f30a-04ab-4be2-b27d-75d80b0e6d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c36f5cc9c864ecf825d772f48f87b78, user_id=e8f4daad02e44a8c9b9c42fa2e3fb2ad, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:11.994219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297f30a-04ab-4be2-b27d-75d80b0e6d60 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:12.008486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1093/2168] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:11 2022] PUT /identity/v3/projects/6c36f5cc9c864ecf825d772f48f87b78/users/e8f4daad02e44a8c9b9c42fa2e3fb2ad/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:12.013569 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb48ef-2cc2-4e0e-9daa-1eab66cb5bd9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:12.013849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb48ef-2cc2-4e0e-9daa-1eab66cb5bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:12.014118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb48ef-2cc2-4e0e-9daa-1eab66cb5bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:12.034031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-90eb48ef-2cc2-4e0e-9daa-1eab66cb5bd9 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:12.035147 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-90eb48ef-2cc2-4e0e-9daa-1eab66cb5bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:12.099398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1076/2169] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:12.109301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297f30a-04ab-4be2-b27d-75d80b0e6d60 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:12.111686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8297f30a-04ab-4be2-b27d-75d80b0e6d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:12.173410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297f30a-04ab-4be2-b27d-75d80b0e6d60 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:12.177504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3080e52-6093-4f67-afef-1350bee8a1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:12.178120 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3080e52-6093-4f67-afef-1350bee8a1fe service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:12.178399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3080e52-6093-4f67-afef-1350bee8a1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:12.178665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3080e52-6093-4f67-afef-1350bee8a1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:12.188486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3080e52-6093-4f67-afef-1350bee8a1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:12.189929 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3080e52-6093-4f67-afef-1350bee8a1fe service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:12.193718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:12.201887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1094/2170] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:18:13.189508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dce3de-9900-4a08-a4ea-2665701bac72 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:13.190075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dce3de-9900-4a08-a4ea-2665701bac72 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:13.190346 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dce3de-9900-4a08-a4ea-2665701bac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:13.220286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b5dce3de-9900-4a08-a4ea-2665701bac72 None None] MFA Rules not processed for user `e8f4daad02e44a8c9b9c42fa2e3fb2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:13.221907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b5dce3de-9900-4a08-a4ea-2665701bac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:13.298451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1077/2171] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:13.301036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3080e52-6093-4f67-afef-1350bee8a1fe service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:13.319366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3080e52-6093-4f67-afef-1350bee8a1fe service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:13.324376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6d213-a28a-47be-9b61-ffdc9269ec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:13.325007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6d213-a28a-47be-9b61-ffdc9269ec44 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:13.325290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6d213-a28a-47be-9b61-ffdc9269ec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:13.325558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6d213-a28a-47be-9b61-ffdc9269ec44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:13.326199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6d213-a28a-47be-9b61-ffdc9269ec44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:13.328096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6d213-a28a-47be-9b61-ffdc9269ec44 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:13.367855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1095/2172] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:13 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:13.372709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dce3de-9900-4a08-a4ea-2665701bac72 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:13.385960 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dce3de-9900-4a08-a4ea-2665701bac72 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:13.447762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e944b-8634-4ca5-b8f3-5de58dfa3b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:13.448462 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e944b-8634-4ca5-b8f3-5de58dfa3b40 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:13.448737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e944b-8634-4ca5-b8f3-5de58dfa3b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:13.449002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e944b-8634-4ca5-b8f3-5de58dfa3b40 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:13.449666 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e944b-8634-4ca5-b8f3-5de58dfa3b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:13.451574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e944b-8634-4ca5-b8f3-5de58dfa3b40 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:13.474397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1078/2173] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:13 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:13.478517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6d213-a28a-47be-9b61-ffdc9269ec44 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:13.489248 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6d213-a28a-47be-9b61-ffdc9269ec44 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:13.494445 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be970b-9261-4125-b9ff-4d31a142430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:13.495152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be970b-9261-4125-b9ff-4d31a142430e admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:13.495535 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be970b-9261-4125-b9ff-4d31a142430e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:13.495808 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be970b-9261-4125-b9ff-4d31a142430e admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:13.496546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be970b-9261-4125-b9ff-4d31a142430e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:13.498216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be970b-9261-4125-b9ff-4d31a142430e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:13.509436 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1096/2174] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:13.514146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e944b-8634-4ca5-b8f3-5de58dfa3b40 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:13.525440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e944b-8634-4ca5-b8f3-5de58dfa3b40 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:13.530697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f5e01-bf09-49d9-819f-6736dc0f94ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:13.531349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f5e01-bf09-49d9-819f-6736dc0f94ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:13.531620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f5e01-bf09-49d9-819f-6736dc0f94ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:13.531892 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f5e01-bf09-49d9-819f-6736dc0f94ff admin admin] PATH_INFO: `/v3/projects/70df542eaf7045c2ace23d5ff5cd3d6f/users/4b4ccc0a5b324ebbaf1ca1f9f94cac91/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:13.540630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:13.548083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f5e01-bf09-49d9-819f-6736dc0f94ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=70df542eaf7045c2ace23d5ff5cd3d6f, user_id=4b4ccc0a5b324ebbaf1ca1f9f94cac91, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:13.551216 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f5e01-bf09-49d9-819f-6736dc0f94ff admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:13.565950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1079/2175] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:13 2022] PUT /identity/v3/projects/70df542eaf7045c2ace23d5ff5cd3d6f/users/4b4ccc0a5b324ebbaf1ca1f9f94cac91/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:13.570292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be970b-9261-4125-b9ff-4d31a142430e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:13.581432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be970b-9261-4125-b9ff-4d31a142430e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:13.642240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd0c53-7851-42e2-8805-df0e373f5bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:13.642760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd0c53-7851-42e2-8805-df0e373f5bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:13.643033 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd0c53-7851-42e2-8805-df0e373f5bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:13.643303 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd0c53-7851-42e2-8805-df0e373f5bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:13.643953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd0c53-7851-42e2-8805-df0e373f5bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:13.645602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd0c53-7851-42e2-8805-df0e373f5bb4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:13.655871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1097/2176] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:13.660338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f5e01-bf09-49d9-819f-6736dc0f94ff admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:13.671349 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f5e01-bf09-49d9-819f-6736dc0f94ff admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:13.676985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a6337-79e9-45ff-be2b-da7dff956395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:13.677650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a6337-79e9-45ff-be2b-da7dff956395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:13.677899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a6337-79e9-45ff-be2b-da7dff956395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:13.678177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a6337-79e9-45ff-be2b-da7dff956395 admin admin] PATH_INFO: `/v3/projects/70df542eaf7045c2ace23d5ff5cd3d6f/users/4b4ccc0a5b324ebbaf1ca1f9f94cac91/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:13.680252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a6337-79e9-45ff-be2b-da7dff956395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70df542eaf7045c2ace23d5ff5cd3d6f, user_id=4b4ccc0a5b324ebbaf1ca1f9f94cac91, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:13.683096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a6337-79e9-45ff-be2b-da7dff956395 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:13.693726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1080/2177] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:13 2022] PUT /identity/v3/projects/70df542eaf7045c2ace23d5ff5cd3d6f/users/4b4ccc0a5b324ebbaf1ca1f9f94cac91/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:14.356170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8683f7e-6db5-45fe-aa88-60d7cd5ee33a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:14.356730 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8683f7e-6db5-45fe-aa88-60d7cd5ee33a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:14.356730 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8683f7e-6db5-45fe-aa88-60d7cd5ee33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:14.388858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b8683f7e-6db5-45fe-aa88-60d7cd5ee33a None None] MFA Rules not processed for user `4b4ccc0a5b324ebbaf1ca1f9f94cac91`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:14.390173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b8683f7e-6db5-45fe-aa88-60d7cd5ee33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:14.492089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1098/2178] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:14.506621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fb6b8-82db-48ea-b3cf-f153eb90e812 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:14.507174 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fb6b8-82db-48ea-b3cf-f153eb90e812 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:14.507378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fb6b8-82db-48ea-b3cf-f153eb90e812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:14.530842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d77fb6b8-82db-48ea-b3cf-f153eb90e812 None None] MFA Rules not processed for user `e8f4daad02e44a8c9b9c42fa2e3fb2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:14.532572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d77fb6b8-82db-48ea-b3cf-f153eb90e812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:14.601286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1081/2179] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:14.615356 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8683f7e-6db5-45fe-aa88-60d7cd5ee33a None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:14.616887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b8683f7e-6db5-45fe-aa88-60d7cd5ee33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:14.666318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:14.693354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8683f7e-6db5-45fe-aa88-60d7cd5ee33a None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:14.699286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a4301-6d24-4c6c-a8ab-19f9c7e04ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:14.699905 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a4301-6d24-4c6c-a8ab-19f9c7e04ccd service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:14.700182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a4301-6d24-4c6c-a8ab-19f9c7e04ccd service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:14.700486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a4301-6d24-4c6c-a8ab-19f9c7e04ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:14.708896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a4301-6d24-4c6c-a8ab-19f9c7e04ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:14.710408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a4301-6d24-4c6c-a8ab-19f9c7e04ccd service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:14.719474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1099/2180] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:14.976180 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fb6b8-82db-48ea-b3cf-f153eb90e812 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:15.046035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fb6b8-82db-48ea-b3cf-f153eb90e812 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:15.049790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786c8e9-5947-45d7-9d83-d1b1fde2254c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:15.050396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786c8e9-5947-45d7-9d83-d1b1fde2254c service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:15.050650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786c8e9-5947-45d7-9d83-d1b1fde2254c service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:15.050973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786c8e9-5947-45d7-9d83-d1b1fde2254c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:15.053424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c786c8e9-5947-45d7-9d83-d1b1fde2254c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:15.065142 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786c8e9-5947-45d7-9d83-d1b1fde2254c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:15.067369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786c8e9-5947-45d7-9d83-d1b1fde2254c service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:15.074885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1082/2181] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:15.401752 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a4301-6d24-4c6c-a8ab-19f9c7e04ccd service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:15.403401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d72a4301-6d24-4c6c-a8ab-19f9c7e04ccd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:15.486551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a4301-6d24-4c6c-a8ab-19f9c7e04ccd service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:15.491812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9aa0a6-2604-4f5b-b88a-a2d4305bd2e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:15.492464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aa0a6-2604-4f5b-b88a-a2d4305bd2e0 service placement] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:15.492745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aa0a6-2604-4f5b-b88a-a2d4305bd2e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:15.493015 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aa0a6-2604-4f5b-b88a-a2d4305bd2e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:15.494789 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5d9aa0a6-2604-4f5b-b88a-a2d4305bd2e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:15.506426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9aa0a6-2604-4f5b-b88a-a2d4305bd2e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:15.508028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9aa0a6-2604-4f5b-b88a-a2d4305bd2e0 service placement] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:15.518447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1100/2182] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:16.006935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786c8e9-5947-45d7-9d83-d1b1fde2254c service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:16.009086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c786c8e9-5947-45d7-9d83-d1b1fde2254c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:16.073585 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786c8e9-5947-45d7-9d83-d1b1fde2254c service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:16.078431 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:16.079087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:16.079365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:16.079637 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] PATH_INFO: `/v3/users/c376f68768b044d78ea868be228d9d1a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:16.080834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c376f68768b044d78ea868be228d9d1a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:16.082776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:16.106169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:16.132513 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c376f68768b044d78ea868be228d9d1a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:16.139217 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c376f68768b044d78ea868be228d9d1a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:16.150698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c376f68768b044d78ea868be228d9d1a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:16.151355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c376f68768b044d78ea868be228d9d1a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:16.151946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c376f68768b044d78ea868be228d9d1a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:16.167166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1083/2183] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:16 2022] DELETE /identity/v3/users/c376f68768b044d78ea868be228d9d1a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:16.171991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa384d5-f439-44b9-9660-e212b65109de None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:16.172275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa384d5-f439-44b9-9660-e212b65109de None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:16.172576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa384d5-f439-44b9-9660-e212b65109de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:16.192963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-0fa384d5-f439-44b9-9660-e212b65109de None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:16.194151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0fa384d5-f439-44b9-9660-e212b65109de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:16.268108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1101/2184] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:16.278281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:16.279732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:16.342705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f18f50-c983-4b39-8d04-8f06e25a7f79 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:16.346700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4efc0-3ddf-4de0-ae57-8e0411effade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:16.347306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4efc0-3ddf-4de0-ae57-8e0411effade service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:16.347589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4efc0-3ddf-4de0-ae57-8e0411effade service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:16.347830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4efc0-3ddf-4de0-ae57-8e0411effade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:16.357496 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4efc0-3ddf-4de0-ae57-8e0411effade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:16.359504 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4efc0-3ddf-4de0-ae57-8e0411effade service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:16.370226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1084/2185] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:16.750324 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa384d5-f439-44b9-9660-e212b65109de None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:16.751915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0fa384d5-f439-44b9-9660-e212b65109de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:16.764760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa384d5-f439-44b9-9660-e212b65109de None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:16.770729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:16.771495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:16.771818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:16.772125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] PATH_INFO: `/v3/projects/8d7edbd6ab2542e2844fd8821dcd29c7` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:16.773282 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7edbd6ab2542e2844fd8821dcd29c7)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:16.775392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:16.823887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7edbd6ab2542e2844fd8821dcd29c7', 'request_id': 'req-b9ef4d53-85df-4fd4-8fa8-73d476657634'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:16.828680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:16.830134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7edbd6ab2542e2844fd8821dcd29c7', 'request_id': 'req-b9ef4d53-85df-4fd4-8fa8-73d476657634'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:16.838579 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7edbd6ab2542e2844fd8821dcd29c7', 'request_id': 'req-b9ef4d53-85df-4fd4-8fa8-73d476657634'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:16.854720 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] The token cache is being invalidate because project 8d7edbd6ab2542e2844fd8821dcd29c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:16.855011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:16.855631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:16.867539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1102/2186] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:16 2022] DELETE /identity/v3/projects/8d7edbd6ab2542e2844fd8821dcd29c7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:18.738158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4efc0-3ddf-4de0-ae57-8e0411effade service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:18.740941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fee4efc0-3ddf-4de0-ae57-8e0411effade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:18.755339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4efc0-3ddf-4de0-ae57-8e0411effade service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:18.808144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b75ac3-0df2-4e9f-92b7-9a1bcc007ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:18.808840 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b75ac3-0df2-4e9f-92b7-9a1bcc007ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:18.809118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b75ac3-0df2-4e9f-92b7-9a1bcc007ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:18.809384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b75ac3-0df2-4e9f-92b7-9a1bcc007ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:18.811471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-08b75ac3-0df2-4e9f-92b7-9a1bcc007ea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:18.822050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b75ac3-0df2-4e9f-92b7-9a1bcc007ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:18.823466 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b75ac3-0df2-4e9f-92b7-9a1bcc007ea3 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:18.831963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1085/2187] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:19.963330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:19.965288 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:20.092821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef4d53-85df-4fd4-8fa8-73d476657634 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:20.098549 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bad5a8-40bf-4b83-a0ce-a52b8897a98b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:20.099246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bad5a8-40bf-4b83-a0ce-a52b8897a98b service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:20.099610 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bad5a8-40bf-4b83-a0ce-a52b8897a98b service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:20.099985 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bad5a8-40bf-4b83-a0ce-a52b8897a98b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:20.101887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-08bad5a8-40bf-4b83-a0ce-a52b8897a98b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:20.115740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bad5a8-40bf-4b83-a0ce-a52b8897a98b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:20.117496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bad5a8-40bf-4b83-a0ce-a52b8897a98b service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:20.134076 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1103/2188] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:25.437467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b75ac3-0df2-4e9f-92b7-9a1bcc007ea3 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:25.451482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b75ac3-0df2-4e9f-92b7-9a1bcc007ea3 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:25.457165 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8da56-a65d-4d82-8a14-087f5a3537ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:25.457766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8da56-a65d-4d82-8a14-087f5a3537ae service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:25.458043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8da56-a65d-4d82-8a14-087f5a3537ae service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:25.458341 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8da56-a65d-4d82-8a14-087f5a3537ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:25.460146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cac8da56-a65d-4d82-8a14-087f5a3537ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:25.472205 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8da56-a65d-4d82-8a14-087f5a3537ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:25.473797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8da56-a65d-4d82-8a14-087f5a3537ae service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:25.484214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1086/2189] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:27.413096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bad5a8-40bf-4b83-a0ce-a52b8897a98b service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:27.414504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-08bad5a8-40bf-4b83-a0ce-a52b8897a98b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:27.429482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bad5a8-40bf-4b83-a0ce-a52b8897a98b service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:27.433168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41ddc3-005f-420b-83db-0502ee0f8dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:27.433777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41ddc3-005f-420b-83db-0502ee0f8dbe service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:27.434053 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41ddc3-005f-420b-83db-0502ee0f8dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:27.434319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41ddc3-005f-420b-83db-0502ee0f8dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:27.436024 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5c41ddc3-005f-420b-83db-0502ee0f8dbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:27.522524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41ddc3-005f-420b-83db-0502ee0f8dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:27.523973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41ddc3-005f-420b-83db-0502ee0f8dbe service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:27.535858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1104/2190] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:29.009510 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8da56-a65d-4d82-8a14-087f5a3537ae service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:29.011102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cac8da56-a65d-4d82-8a14-087f5a3537ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:29.051021 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:29.077135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8da56-a65d-4d82-8a14-087f5a3537ae service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:29.080913 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcc984-8254-4715-899e-323b7e09be42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:29.081680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcc984-8254-4715-899e-323b7e09be42 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:29.082055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcc984-8254-4715-899e-323b7e09be42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:29.082798 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcc984-8254-4715-899e-323b7e09be42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:29.085057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-35fcc984-8254-4715-899e-323b7e09be42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:29.158993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcc984-8254-4715-899e-323b7e09be42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:29.160497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcc984-8254-4715-899e-323b7e09be42 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:29.171690 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1087/2191] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:30.060562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f1856-6082-4974-be06-b19349c24e49 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:30.061088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f1856-6082-4974-be06-b19349c24e49 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:30.061243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f1856-6082-4974-be06-b19349c24e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:30.103769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-038f1856-6082-4974-be06-b19349c24e49 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:30.105040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-038f1856-6082-4974-be06-b19349c24e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:30.172448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1105/2192] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:18:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:30.181149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcc984-8254-4715-899e-323b7e09be42 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:30.182776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-35fcc984-8254-4715-899e-323b7e09be42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:30.275191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcc984-8254-4715-899e-323b7e09be42 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:30.281519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cd68d-2b4f-4fb3-a523-bda7f309a610 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:30.282957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd68d-2b4f-4fb3-a523-bda7f309a610 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:30.283324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd68d-2b4f-4fb3-a523-bda7f309a610 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:30.283792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd68d-2b4f-4fb3-a523-bda7f309a610 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:30.293790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423cd68d-2b4f-4fb3-a523-bda7f309a610 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:30.295608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423cd68d-2b4f-4fb3-a523-bda7f309a610 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:30.305257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1088/2193] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:18:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:18:31.262595 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f1856-6082-4974-be06-b19349c24e49 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:31.264056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-038f1856-6082-4974-be06-b19349c24e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:31.284101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f1856-6082-4974-be06-b19349c24e49 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:31.289893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:31.292472 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:31.292886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:31.293157 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] PATH_INFO: `/v3/users/8d4c78fc725b440eb266b0365cbfcedd` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:31.294374 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4c78fc725b440eb266b0365cbfcedd)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:31.296405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:31.300381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:31.376247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4c78fc725b440eb266b0365cbfcedd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:31.385945 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4c78fc725b440eb266b0365cbfcedd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:31.388822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4c78fc725b440eb266b0365cbfcedd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:31.421484 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4c78fc725b440eb266b0365cbfcedd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:31.423267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e08a7ab5-0b2c-424f-8b39-bf0bc0f87828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4c78fc725b440eb266b0365cbfcedd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:31.455175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1106/2194] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:31 2022] DELETE /identity/v3/users/8d4c78fc725b440eb266b0365cbfcedd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:18:31.772936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cd68d-2b4f-4fb3-a523-bda7f309a610 service swift] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:31.788989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cd68d-2b4f-4fb3-a523-bda7f309a610 service swift] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:31.903703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:31.904680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:31.905181 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:31.905659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] PATH_INFO: `/v3/projects/5efe8793826042dc9ab48911370a7715` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:31.907656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efe8793826042dc9ab48911370a7715)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:31.909702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:31.940012 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:31.984204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efe8793826042dc9ab48911370a7715', 'request_id': 'req-da50f6eb-ed4f-44a7-958d-09b1aedfad78'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:31.998409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efe8793826042dc9ab48911370a7715', 'request_id': 'req-da50f6eb-ed4f-44a7-958d-09b1aedfad78'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:32.006433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efe8793826042dc9ab48911370a7715', 'request_id': 'req-da50f6eb-ed4f-44a7-958d-09b1aedfad78'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:32.018635 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] The token cache is being invalidate because project 5efe8793826042dc9ab48911370a7715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:32.019242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:32.026400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-da50f6eb-ed4f-44a7-958d-09b1aedfad78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:32.032149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1089/2195] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:31 2022] DELETE /identity/v3/projects/5efe8793826042dc9ab48911370a7715 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:32.034544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4fead-d6b3-4750-b27c-8441b1f38c29 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:32.034857 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4fead-d6b3-4750-b27c-8441b1f38c29 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:32.035128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4fead-d6b3-4750-b27c-8441b1f38c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:32.055686 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-f9b4fead-d6b3-4750-b27c-8441b1f38c29 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:32.056962 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f9b4fead-d6b3-4750-b27c-8441b1f38c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:32.144456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1107/2196] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:32.153449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0ac0-e27a-41fe-b23c-24660efac40b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:32.154344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0ac0-e27a-41fe-b23c-24660efac40b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:32.154869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0ac0-e27a-41fe-b23c-24660efac40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:32.195480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-51df0ac0-e27a-41fe-b23c-24660efac40b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:32.197058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-51df0ac0-e27a-41fe-b23c-24660efac40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:32.212674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1090/2197] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:32.213074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4fead-d6b3-4750-b27c-8441b1f38c29 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:32.241774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4fead-d6b3-4750-b27c-8441b1f38c29 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:32.253854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e2a26-3591-4c0f-bf57-0b444c19de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:32.254764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2a26-3591-4c0f-bf57-0b444c19de30 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:32.255241 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2a26-3591-4c0f-bf57-0b444c19de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:32.255674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2a26-3591-4c0f-bf57-0b444c19de30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:32.260422 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e2a26-3591-4c0f-bf57-0b444c19de30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:32.260422 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e2a26-3591-4c0f-bf57-0b444c19de30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:32.263377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e2a26-3591-4c0f-bf57-0b444c19de30 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:32.276589 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1108/2198] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:18:32.281273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0ac0-e27a-41fe-b23c-24660efac40b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:32.298061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0ac0-e27a-41fe-b23c-24660efac40b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:32.304208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c6ec7-4383-4244-a7a3-710d3cf5027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:32.305043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c6ec7-4383-4244-a7a3-710d3cf5027a admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:32.305473 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c6ec7-4383-4244-a7a3-710d3cf5027a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:32.305927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c6ec7-4383-4244-a7a3-710d3cf5027a admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:32.308684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c6ec7-4383-4244-a7a3-710d3cf5027a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:32.310851 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c6ec7-4383-4244-a7a3-710d3cf5027a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:32.354835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1091/2199] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:32 2022] POST /identity/v3/projects => generated 405 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:32.355606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e2a26-3591-4c0f-bf57-0b444c19de30 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:32.380592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e2a26-3591-4c0f-bf57-0b444c19de30 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:32.533188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cec283-0d4e-4d22-bf7e-9b24968275c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:32.533796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cec283-0d4e-4d22-bf7e-9b24968275c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:32.534080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cec283-0d4e-4d22-bf7e-9b24968275c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:32.534355 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cec283-0d4e-4d22-bf7e-9b24968275c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:32.535006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cec283-0d4e-4d22-bf7e-9b24968275c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:32.537048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cec283-0d4e-4d22-bf7e-9b24968275c3 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:32.560758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:32.571853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1109/2200] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:32 2022] POST /identity/v3/users => generated 303 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:32.573042 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c6ec7-4383-4244-a7a3-710d3cf5027a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:32.584426 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c6ec7-4383-4244-a7a3-710d3cf5027a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:32.592911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078369e6-3f7f-42e4-b892-148e0ea3a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:32.593535 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078369e6-3f7f-42e4-b892-148e0ea3a26f admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:32.593808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078369e6-3f7f-42e4-b892-148e0ea3a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:32.594079 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078369e6-3f7f-42e4-b892-148e0ea3a26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:32.594819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078369e6-3f7f-42e4-b892-148e0ea3a26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:32.596553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078369e6-3f7f-42e4-b892-148e0ea3a26f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:32.612507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cec283-0d4e-4d22-bf7e-9b24968275c3 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:32.623370 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cec283-0d4e-4d22-bf7e-9b24968275c3 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:32.624457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1092/2201] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:32.629297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a8d7e-4631-4be6-89a7-d29794c124a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:32.629903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a8d7e-4631-4be6-89a7-d29794c124a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:32.630165 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a8d7e-4631-4be6-89a7-d29794c124a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:32.630437 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a8d7e-4631-4be6-89a7-d29794c124a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:32.631089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a8d7e-4631-4be6-89a7-d29794c124a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:32.632991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a8d7e-4631-4be6-89a7-d29794c124a0 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:32.650257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078369e6-3f7f-42e4-b892-148e0ea3a26f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:32.651325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1110/2202] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:32.660808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078369e6-3f7f-42e4-b892-148e0ea3a26f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:32.665408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9142e6-541b-4869-917a-89d9b379fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:32.666095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9142e6-541b-4869-917a-89d9b379fe65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:32.666372 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9142e6-541b-4869-917a-89d9b379fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:32.666641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9142e6-541b-4869-917a-89d9b379fe65 admin admin] PATH_INFO: `/v3/projects/2f0d142a9c0a45f3a1d72211a2a4cbc7/users/e6f975066cd24b36bf2b214059832f53/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:32.683171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9142e6-541b-4869-917a-89d9b379fe65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0d142a9c0a45f3a1d72211a2a4cbc7, user_id=e6f975066cd24b36bf2b214059832f53, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:32.685796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9142e6-541b-4869-917a-89d9b379fe65 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:32.705661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1093/2203] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:32 2022] PUT /identity/v3/projects/2f0d142a9c0a45f3a1d72211a2a4cbc7/users/e6f975066cd24b36bf2b214059832f53/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:32.707479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f411b-d444-4724-a2c9-270a5c7d9c83 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:32.707786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f411b-d444-4724-a2c9-270a5c7d9c83 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:32.708011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f411b-d444-4724-a2c9-270a5c7d9c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:32.729854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-eb0f411b-d444-4724-a2c9-270a5c7d9c83 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:32.731386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-eb0f411b-d444-4724-a2c9-270a5c7d9c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:32.822581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1111/2204] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:32.829777 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9142e6-541b-4869-917a-89d9b379fe65 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:32.832550 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8a9142e6-541b-4869-917a-89d9b379fe65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:32.933961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9142e6-541b-4869-917a-89d9b379fe65 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:32.940407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38013-20b1-4f38-89a6-998c81fae94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:32.941384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38013-20b1-4f38-89a6-998c81fae94a service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:32.942373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38013-20b1-4f38-89a6-998c81fae94a service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:32.942740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38013-20b1-4f38-89a6-998c81fae94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:32.954259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38013-20b1-4f38-89a6-998c81fae94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:32.956189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38013-20b1-4f38-89a6-998c81fae94a service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:32.967936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1094/2205] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:33.714246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126add-12ea-4218-8d45-e7a5ea9a6ddc None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:33.714926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126add-12ea-4218-8d45-e7a5ea9a6ddc None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:33.715044 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126add-12ea-4218-8d45-e7a5ea9a6ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:33.751245 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-e2126add-12ea-4218-8d45-e7a5ea9a6ddc None None] MFA Rules not processed for user `e6f975066cd24b36bf2b214059832f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:33.752683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e2126add-12ea-4218-8d45-e7a5ea9a6ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:33.834208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1112/2206] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:33.840008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38013-20b1-4f38-89a6-998c81fae94a service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:33.857062 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38013-20b1-4f38-89a6-998c81fae94a service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:33.866332 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d388a6-ccb0-45bd-b267-cebe772697a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:33.868751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d388a6-ccb0-45bd-b267-cebe772697a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:33.869351 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d388a6-ccb0-45bd-b267-cebe772697a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:33.869626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d388a6-ccb0-45bd-b267-cebe772697a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:33.870276 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d388a6-ccb0-45bd-b267-cebe772697a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:33.875427 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d388a6-ccb0-45bd-b267-cebe772697a8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:33.957688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1095/2207] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:33 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:33.962529 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2126add-12ea-4218-8d45-e7a5ea9a6ddc None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:33.976585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2126add-12ea-4218-8d45-e7a5ea9a6ddc None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:34.079049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a47e95-c40f-47ae-999e-b131e552c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:34.079745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47e95-c40f-47ae-999e-b131e552c6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:34.080004 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47e95-c40f-47ae-999e-b131e552c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:34.080274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47e95-c40f-47ae-999e-b131e552c6ce admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:34.082210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a47e95-c40f-47ae-999e-b131e552c6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:34.089705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a47e95-c40f-47ae-999e-b131e552c6ce admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:34.164920 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1113/2208] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:33 2022] POST /identity/v3/users => generated 308 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:34.168962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d388a6-ccb0-45bd-b267-cebe772697a8 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:34.181294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d388a6-ccb0-45bd-b267-cebe772697a8 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:34.186141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ffa1c-b3ee-4bf7-8ba5-e39b2b2338f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:34.186749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ffa1c-b3ee-4bf7-8ba5-e39b2b2338f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:34.187024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ffa1c-b3ee-4bf7-8ba5-e39b2b2338f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:34.187348 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ffa1c-b3ee-4bf7-8ba5-e39b2b2338f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:34.190285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ffa1c-b3ee-4bf7-8ba5-e39b2b2338f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:34.190285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ffa1c-b3ee-4bf7-8ba5-e39b2b2338f9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:34.206759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1096/2209] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:34.207531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a47e95-c40f-47ae-999e-b131e552c6ce admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:34.220378 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a47e95-c40f-47ae-999e-b131e552c6ce admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:34.225716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77238-463f-43eb-9c42-6068f22f6b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:34.226605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77238-463f-43eb-9c42-6068f22f6b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:34.226874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77238-463f-43eb-9c42-6068f22f6b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:34.227765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77238-463f-43eb-9c42-6068f22f6b72 admin admin] PATH_INFO: `/v3/projects/0be8e669148a42a7a077180be212734a/users/bf38bb4c1b554970b2bdca66849652d8/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:34.232037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:34.255622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77238-463f-43eb-9c42-6068f22f6b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be8e669148a42a7a077180be212734a, user_id=bf38bb4c1b554970b2bdca66849652d8, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:34.258377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77238-463f-43eb-9c42-6068f22f6b72 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:34.282713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ffa1c-b3ee-4bf7-8ba5-e39b2b2338f9 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:34.283728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1114/2210] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:34 2022] PUT /identity/v3/projects/0be8e669148a42a7a077180be212734a/users/bf38bb4c1b554970b2bdca66849652d8/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:34.309393 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ffa1c-b3ee-4bf7-8ba5-e39b2b2338f9 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:34.315611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:34.414392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ac02a-860d-4045-8d67-e80db9ace495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:34.414963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ac02a-860d-4045-8d67-e80db9ace495 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:34.415388 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ac02a-860d-4045-8d67-e80db9ace495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:34.415664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ac02a-860d-4045-8d67-e80db9ace495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:34.416382 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ac02a-860d-4045-8d67-e80db9ace495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:34.418041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ac02a-860d-4045-8d67-e80db9ace495 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:34.429853 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1097/2211] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:34.433622 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77238-463f-43eb-9c42-6068f22f6b72 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:34.445465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77238-463f-43eb-9c42-6068f22f6b72 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:34.450983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118717-4e99-4f49-8b49-5f206f5daf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:34.451645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118717-4e99-4f49-8b49-5f206f5daf39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:34.451922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118717-4e99-4f49-8b49-5f206f5daf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:34.452207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118717-4e99-4f49-8b49-5f206f5daf39 admin admin] PATH_INFO: `/v3/projects/0be8e669148a42a7a077180be212734a/users/bf38bb4c1b554970b2bdca66849652d8/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:34.454260 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26118717-4e99-4f49-8b49-5f206f5daf39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be8e669148a42a7a077180be212734a, user_id=bf38bb4c1b554970b2bdca66849652d8, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:34.457026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26118717-4e99-4f49-8b49-5f206f5daf39 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:34.468073 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1115/2212] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:34 2022] PUT /identity/v3/projects/0be8e669148a42a7a077180be212734a/users/bf38bb4c1b554970b2bdca66849652d8/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:35.365640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8cf8-d574-419f-bee7-3b2807d9b46d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:35.366480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8cf8-d574-419f-bee7-3b2807d9b46d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:35.366902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8cf8-d574-419f-bee7-3b2807d9b46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:35.447028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f34b8cf8-d574-419f-bee7-3b2807d9b46d None None] MFA Rules not processed for user `bf38bb4c1b554970b2bdca66849652d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:35.449375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f34b8cf8-d574-419f-bee7-3b2807d9b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:35.638144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1098/2213] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:37.082528 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118717-4e99-4f49-8b49-5f206f5daf39 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:37.198139 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118717-4e99-4f49-8b49-5f206f5daf39 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:37.203214 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:37.203969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:37.204307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:37.204577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] PATH_INFO: `/v3/users/e6f975066cd24b36bf2b214059832f53` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:37.205726 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f975066cd24b36bf2b214059832f53)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:37.208219 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:37.300550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f975066cd24b36bf2b214059832f53'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.314722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f975066cd24b36bf2b214059832f53'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.315565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f975066cd24b36bf2b214059832f53'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.333864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f975066cd24b36bf2b214059832f53'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.334858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f975066cd24b36bf2b214059832f53'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.352286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1116/2214] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:37 2022] DELETE /identity/v3/users/e6f975066cd24b36bf2b214059832f53 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:37.558073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b8cf8-d574-419f-bee7-3b2807d9b46d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:37.572049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b8cf8-d574-419f-bee7-3b2807d9b46d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:37.651084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:37.651817 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:37.652098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:37.652400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] PATH_INFO: `/v3/projects/2f0d142a9c0a45f3a1d72211a2a4cbc7` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:37.653907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0d142a9c0a45f3a1d72211a2a4cbc7)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:37.655854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:37.696522 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:37.711404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0d142a9c0a45f3a1d72211a2a4cbc7', 'request_id': 'req-06b63067-2fd7-459e-8e0a-763483f90288'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.720682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0d142a9c0a45f3a1d72211a2a4cbc7', 'request_id': 'req-06b63067-2fd7-459e-8e0a-763483f90288'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.728110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0d142a9c0a45f3a1d72211a2a4cbc7', 'request_id': 'req-06b63067-2fd7-459e-8e0a-763483f90288'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.739861 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] The token cache is being invalidate because project 2f0d142a9c0a45f3a1d72211a2a4cbc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:37.740146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.740840 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.744368 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1099/2215] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:37 2022] DELETE /identity/v3/projects/2f0d142a9c0a45f3a1d72211a2a4cbc7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:37.749025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:37.750574 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:37.763906 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e216ad-5fce-445a-95ea-6d8c0d8668e0 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:37.825297 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:37.840055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:37.840998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:37.841301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:37.841729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] PATH_INFO: `/v3/users/bf38bb4c1b554970b2bdca66849652d8` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:37.842964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf38bb4c1b554970b2bdca66849652d8)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:37.844981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:37.923670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf38bb4c1b554970b2bdca66849652d8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.934413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf38bb4c1b554970b2bdca66849652d8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.935674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf38bb4c1b554970b2bdca66849652d8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.951653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf38bb4c1b554970b2bdca66849652d8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.952697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-fa9a4d21-945d-45a0-ab1c-7a5021d67f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf38bb4c1b554970b2bdca66849652d8'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:37.997268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1117/2216] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:37 2022] DELETE /identity/v3/users/bf38bb4c1b554970b2bdca66849652d8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:38.207100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:38.208497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:38.230362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b63067-2fd7-459e-8e0a-763483f90288 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:38.324521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:38.325670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.331594 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.332254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] PATH_INFO: `/v3/projects/0be8e669148a42a7a077180be212734a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.333782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be8e669148a42a7a077180be212734a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:38.335972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:38.400390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be8e669148a42a7a077180be212734a', 'request_id': 'req-ae7215fb-f0dd-4293-b80a-add30c9caf06'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.412839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be8e669148a42a7a077180be212734a', 'request_id': 'req-ae7215fb-f0dd-4293-b80a-add30c9caf06'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.421726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be8e669148a42a7a077180be212734a', 'request_id': 'req-ae7215fb-f0dd-4293-b80a-add30c9caf06'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.446617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] The token cache is being invalidate because project 0be8e669148a42a7a077180be212734a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:38.446617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.446617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-ae7215fb-f0dd-4293-b80a-add30c9caf06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:38.453218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1100/2217] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:38 2022] DELETE /identity/v3/projects/0be8e669148a42a7a077180be212734a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:38.454428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b07d2e-addf-47a2-be24-fce546c7bc10 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.454909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b07d2e-addf-47a2-be24-fce546c7bc10 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.455008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b07d2e-addf-47a2-be24-fce546c7bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.480465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-03b07d2e-addf-47a2-be24-fce546c7bc10 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:38.482151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-03b07d2e-addf-47a2-be24-fce546c7bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:38.561786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1118/2218] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:38.572139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad8b24-cb09-43dc-88a5-e31d91985e98 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.573239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad8b24-cb09-43dc-88a5-e31d91985e98 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.573730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad8b24-cb09-43dc-88a5-e31d91985e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.601839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-93ad8b24-cb09-43dc-88a5-e31d91985e98 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:38.603564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-93ad8b24-cb09-43dc-88a5-e31d91985e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:38.626173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1101/2219] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:18:38.626711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b07d2e-addf-47a2-be24-fce546c7bc10 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:38.637651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b07d2e-addf-47a2-be24-fce546c7bc10 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:38.642879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2a78-178d-4194-ab9c-3c2dee7a4fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:38.643562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2a78-178d-4194-ab9c-3c2dee7a4fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.643829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2a78-178d-4194-ab9c-3c2dee7a4fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.644113 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2a78-178d-4194-ab9c-3c2dee7a4fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.644807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c2a78-178d-4194-ab9c-3c2dee7a4fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:38.645106 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c2a78-178d-4194-ab9c-3c2dee7a4fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:38.646751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c2a78-178d-4194-ab9c-3c2dee7a4fb7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:38.674344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1119/2220] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:38.680407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad8b24-cb09-43dc-88a5-e31d91985e98 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:38.691581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad8b24-cb09-43dc-88a5-e31d91985e98 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:38.703147 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8d623-538b-4fd8-9b4b-8af8044cf6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:38.703854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8d623-538b-4fd8-9b4b-8af8044cf6df admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.704190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8d623-538b-4fd8-9b4b-8af8044cf6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.704567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8d623-538b-4fd8-9b4b-8af8044cf6df admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.705271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8d623-538b-4fd8-9b4b-8af8044cf6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:38.707279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8d623-538b-4fd8-9b4b-8af8044cf6df admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:38.742423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1102/2221] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:38 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:38.747070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2a78-178d-4194-ab9c-3c2dee7a4fb7 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:38.761721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2a78-178d-4194-ab9c-3c2dee7a4fb7 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:38.822879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:38.838417 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a1ba1-66b8-4822-adbc-283665c5cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:38.845821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a1ba1-66b8-4822-adbc-283665c5cf2b admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.846148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a1ba1-66b8-4822-adbc-283665c5cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.846418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a1ba1-66b8-4822-adbc-283665c5cf2b admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.848340 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a1ba1-66b8-4822-adbc-283665c5cf2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:38.849469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a1ba1-66b8-4822-adbc-283665c5cf2b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:38.880527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1120/2222] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:38 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:38.881477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8d623-538b-4fd8-9b4b-8af8044cf6df admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:38.894176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8d623-538b-4fd8-9b4b-8af8044cf6df admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:38.900154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb50567-86fc-4d21-b764-ed3640422276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:38.900954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb50567-86fc-4d21-b764-ed3640422276 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.901215 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb50567-86fc-4d21-b764-ed3640422276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.901482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb50567-86fc-4d21-b764-ed3640422276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.902433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb50567-86fc-4d21-b764-ed3640422276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:38.904044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb50567-86fc-4d21-b764-ed3640422276 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:38.920006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1103/2223] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:38.921460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a1ba1-66b8-4822-adbc-283665c5cf2b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:38.935280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a1ba1-66b8-4822-adbc-283665c5cf2b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:38.940573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce76ef6-eda3-4e13-9cea-2962b577209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:38.941318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76ef6-eda3-4e13-9cea-2962b577209c admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.941590 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76ef6-eda3-4e13-9cea-2962b577209c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.941863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76ef6-eda3-4e13-9cea-2962b577209c admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.942606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce76ef6-eda3-4e13-9cea-2962b577209c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:38.944213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce76ef6-eda3-4e13-9cea-2962b577209c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:38.959074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1121/2224] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:38.963256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb50567-86fc-4d21-b764-ed3640422276 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:38.977544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb50567-86fc-4d21-b764-ed3640422276 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:38.983247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36993e-31c0-4181-9703-35709480d148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:38.983962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36993e-31c0-4181-9703-35709480d148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:38.984234 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36993e-31c0-4181-9703-35709480d148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:38.984549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36993e-31c0-4181-9703-35709480d148 admin admin] PATH_INFO: `/v3/projects/b4d3e2b1323d4aab9ef408c31f54026c/users/e8a4344d5f0640929b48c7f586186bd0/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:38.994360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:39.002204 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36993e-31c0-4181-9703-35709480d148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d3e2b1323d4aab9ef408c31f54026c, user_id=e8a4344d5f0640929b48c7f586186bd0, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.005495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36993e-31c0-4181-9703-35709480d148 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.022609 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1104/2225] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:38 2022] PUT /identity/v3/projects/b4d3e2b1323d4aab9ef408c31f54026c/users/e8a4344d5f0640929b48c7f586186bd0/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:18:39.034043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1b3ed-4aa4-485b-a704-8b5997e04f36 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.034683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1b3ed-4aa4-485b-a704-8b5997e04f36 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.035268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1b3ed-4aa4-485b-a704-8b5997e04f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.071194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-f3a1b3ed-4aa4-485b-a704-8b5997e04f36 None None] MFA Rules not processed for user `e8a4344d5f0640929b48c7f586186bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:39.072990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f3a1b3ed-4aa4-485b-a704-8b5997e04f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:39.146981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1122/2226] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:39.151895 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36993e-31c0-4181-9703-35709480d148 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.248778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36993e-31c0-4181-9703-35709480d148 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:39.256894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e33ef9-1352-4ed8-991d-d15acc4cee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:39.257529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e33ef9-1352-4ed8-991d-d15acc4cee2c admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.257809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e33ef9-1352-4ed8-991d-d15acc4cee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.258080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e33ef9-1352-4ed8-991d-d15acc4cee2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.258724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e33ef9-1352-4ed8-991d-d15acc4cee2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.260680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e33ef9-1352-4ed8-991d-d15acc4cee2c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.307102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1105/2227] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:39 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:39.307944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1b3ed-4aa4-485b-a704-8b5997e04f36 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.327856 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1b3ed-4aa4-485b-a704-8b5997e04f36 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:39.439768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424c3f8-d196-4411-9724-15f6be32eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:39.440098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424c3f8-d196-4411-9724-15f6be32eec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.440476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424c3f8-d196-4411-9724-15f6be32eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.440581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424c3f8-d196-4411-9724-15f6be32eec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.441448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424c3f8-d196-4411-9724-15f6be32eec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.444672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424c3f8-d196-4411-9724-15f6be32eec3 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.488065 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1123/2228] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:39 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:39.492104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e33ef9-1352-4ed8-991d-d15acc4cee2c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.502902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e33ef9-1352-4ed8-991d-d15acc4cee2c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:39.508222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b180d-2aad-4931-85e0-f178a746c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:39.508967 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b180d-2aad-4931-85e0-f178a746c4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.509229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b180d-2aad-4931-85e0-f178a746c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.509508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b180d-2aad-4931-85e0-f178a746c4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.510258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b180d-2aad-4931-85e0-f178a746c4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.512043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b180d-2aad-4931-85e0-f178a746c4ac admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.523900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1106/2229] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:39.528021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424c3f8-d196-4411-9724-15f6be32eec3 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.539384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424c3f8-d196-4411-9724-15f6be32eec3 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:39.544922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcb697-011c-48d8-8e67-17af5323e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:39.545790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcb697-011c-48d8-8e67-17af5323e8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.546227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcb697-011c-48d8-8e67-17af5323e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.546725 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcb697-011c-48d8-8e67-17af5323e8fe admin admin] PATH_INFO: `/v3/projects/82f810c4f73d49d787de3b44e389bf85/users/445e545e903f4827ad7ad47ac71991bd/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.566342 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcb697-011c-48d8-8e67-17af5323e8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f810c4f73d49d787de3b44e389bf85, user_id=445e545e903f4827ad7ad47ac71991bd, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.569895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcb697-011c-48d8-8e67-17af5323e8fe admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.589185 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1124/2230] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:39 2022] PUT /identity/v3/projects/82f810c4f73d49d787de3b44e389bf85/users/445e545e903f4827ad7ad47ac71991bd/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:39.590393 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b180d-2aad-4931-85e0-f178a746c4ac admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.608219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b180d-2aad-4931-85e0-f178a746c4ac admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:39.709796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c3cdf-75ee-4ceb-a075-a2f42e17808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:39.710497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3cdf-75ee-4ceb-a075-a2f42e17808f admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.710832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3cdf-75ee-4ceb-a075-a2f42e17808f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.711127 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3cdf-75ee-4ceb-a075-a2f42e17808f admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.718435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c3cdf-75ee-4ceb-a075-a2f42e17808f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.718435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c3cdf-75ee-4ceb-a075-a2f42e17808f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.748174 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1107/2231] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:39.749648 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcb697-011c-48d8-8e67-17af5323e8fe admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.764930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcb697-011c-48d8-8e67-17af5323e8fe admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:39.772070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fdb8b-5548-444c-94af-db510ee4d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:39.772970 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fdb8b-5548-444c-94af-db510ee4d1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.773344 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fdb8b-5548-444c-94af-db510ee4d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.773956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fdb8b-5548-444c-94af-db510ee4d1d8 admin admin] PATH_INFO: `/v3/projects/82f810c4f73d49d787de3b44e389bf85/users/445e545e903f4827ad7ad47ac71991bd/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.776287 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fdb8b-5548-444c-94af-db510ee4d1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f810c4f73d49d787de3b44e389bf85, user_id=445e545e903f4827ad7ad47ac71991bd, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:39.779847 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fdb8b-5548-444c-94af-db510ee4d1d8 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:39.792788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1125/2232] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:39 2022] PUT /identity/v3/projects/82f810c4f73d49d787de3b44e389bf85/users/445e545e903f4827ad7ad47ac71991bd/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:39.804399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64858d-bb3e-4055-94be-d177991cde71 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:39.804696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64858d-bb3e-4055-94be-d177991cde71 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:39.804969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64858d-bb3e-4055-94be-d177991cde71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:39.839124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8a64858d-bb3e-4055-94be-d177991cde71 None None] MFA Rules not processed for user `445e545e903f4827ad7ad47ac71991bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:39.840620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8a64858d-bb3e-4055-94be-d177991cde71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:39.900191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:39.941561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1108/2233] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:39.953483 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fdb8b-5548-444c-94af-db510ee4d1d8 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:39.957128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a69fdb8b-5548-444c-94af-db510ee4d1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:39.990737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:40.071958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fdb8b-5548-444c-94af-db510ee4d1d8 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:40.078373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c67b2-c272-4e36-86fd-6d4d9c6b90f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:40.079011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c67b2-c272-4e36-86fd-6d4d9c6b90f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.079298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c67b2-c272-4e36-86fd-6d4d9c6b90f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.079695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c67b2-c272-4e36-86fd-6d4d9c6b90f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.096402 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c67b2-c272-4e36-86fd-6d4d9c6b90f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:40.098402 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c67b2-c272-4e36-86fd-6d4d9c6b90f8 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:40.127232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1126/2234] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:40.229259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64858d-bb3e-4055-94be-d177991cde71 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:40.240314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64858d-bb3e-4055-94be-d177991cde71 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:40.244161 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17611531-b251-4bd4-8da4-738e4bcf576f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:40.244987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611531-b251-4bd4-8da4-738e4bcf576f service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:40.245306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611531-b251-4bd4-8da4-738e4bcf576f service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:40.245576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611531-b251-4bd4-8da4-738e4bcf576f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:40.313298 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17611531-b251-4bd4-8da4-738e4bcf576f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:40.314946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17611531-b251-4bd4-8da4-738e4bcf576f service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:40.328306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1109/2235] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:46.342271 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e902f-edfa-4bfb-b535-87e12470f756 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.342785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e902f-edfa-4bfb-b535-87e12470f756 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.342785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e902f-edfa-4bfb-b535-87e12470f756 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.344744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1127/2236] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:18:46.353036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12394152-9dac-4379-891c-5c8897c19734 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.353558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12394152-9dac-4379-891c-5c8897c19734 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.353558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12394152-9dac-4379-891c-5c8897c19734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.380500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-12394152-9dac-4379-891c-5c8897c19734 None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:46.381918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-12394152-9dac-4379-891c-5c8897c19734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.486200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1110/2237] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:46.507361 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e902f-edfa-4bfb-b535-87e12470f756 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.510584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-267e902f-edfa-4bfb-b535-87e12470f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.578602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e902f-edfa-4bfb-b535-87e12470f756 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.583765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b623576-d8fc-4bb1-a4a1-675057de59e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47768a5f86d4c6292099691f6cab1e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.584459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b623576-d8fc-4bb1-a4a1-675057de59e1 service glance] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.584733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b623576-d8fc-4bb1-a4a1-675057de59e1 service glance] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.585025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b623576-d8fc-4bb1-a4a1-675057de59e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.597334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b623576-d8fc-4bb1-a4a1-675057de59e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.599095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b623576-d8fc-4bb1-a4a1-675057de59e1 service glance] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.611621 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1128/2238] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:46.687713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f325f-c021-4246-a2d1-5f108335fbdb None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.688133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f325f-c021-4246-a2d1-5f108335fbdb None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.688454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f325f-c021-4246-a2d1-5f108335fbdb None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.690004 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1111/2239] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:18:46.694625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216a6a-e7e4-40e3-a519-790d9921ce91 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.694913 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216a6a-e7e4-40e3-a519-790d9921ce91 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.695194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216a6a-e7e4-40e3-a519-790d9921ce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.714929 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-bc216a6a-e7e4-40e3-a519-790d9921ce91 None None] MFA Rules not processed for user `974f2acdadf14df69cbe33351ee02a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:46.716382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bc216a6a-e7e4-40e3-a519-790d9921ce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.767701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1129/2240] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:46.780199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f325f-c021-4246-a2d1-5f108335fbdb None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.782398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-323f325f-c021-4246-a2d1-5f108335fbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.796318 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f325f-c021-4246-a2d1-5f108335fbdb None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.799891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132026-5510-47e5-bf03-b320bad657c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.800527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132026-5510-47e5-bf03-b320bad657c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.800803 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132026-5510-47e5-bf03-b320bad657c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.801094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132026-5510-47e5-bf03-b320bad657c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.808250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42132026-5510-47e5-bf03-b320bad657c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.809753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42132026-5510-47e5-bf03-b320bad657c8 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.817899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1112/2241] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:46.902863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5fac-7952-438d-94a9-787261203273 None None] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.903170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5fac-7952-438d-94a9-787261203273 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.903473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5fac-7952-438d-94a9-787261203273 None None] PATH_INFO: `/` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.905023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1130/2242] 10.222.0.15 () {54 vars in 921 bytes} [Mon Oct 24 13:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 13:18:46.910969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855cbe5-6bf1-455e-9115-1bb353de1162 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.911198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855cbe5-6bf1-455e-9115-1bb353de1162 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.911474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855cbe5-6bf1-455e-9115-1bb353de1162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.931723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b855cbe5-6bf1-455e-9115-1bb353de1162 None None] MFA Rules not processed for user `d66e6f6ea62d439c87d9551286d29615`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:46.932981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b855cbe5-6bf1-455e-9115-1bb353de1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:46.942771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1113/2243] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Oct 24 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:46.953844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5fac-7952-438d-94a9-787261203273 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:46.965014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5fac-7952-438d-94a9-787261203273 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:46.969233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb04d3a-9bdf-407f-b44f-cd2a7d3c7f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:46.969960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb04d3a-9bdf-407f-b44f-cd2a7d3c7f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:46.970289 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb04d3a-9bdf-407f-b44f-cd2a7d3c7f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:46.970604 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb04d3a-9bdf-407f-b44f-cd2a7d3c7f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:46.981909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb04d3a-9bdf-407f-b44f-cd2a7d3c7f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:46.983558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb04d3a-9bdf-407f-b44f-cd2a7d3c7f7f service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:46.995687 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1131/2244] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:18:48.829919 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27e77-15a3-4c1a-8d25-1fa469024714 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:48.830804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27e77-15a3-4c1a-8d25-1fa469024714 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:48.831929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27e77-15a3-4c1a-8d25-1fa469024714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:48.854070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9fe27e77-15a3-4c1a-8d25-1fa469024714 None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:48.859157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9fe27e77-15a3-4c1a-8d25-1fa469024714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:48.918134 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:48.928048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1114/2245] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Oct 24 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:48.949879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb04d3a-9bdf-407f-b44f-cd2a7d3c7f7f service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:48.951422 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4cb04d3a-9bdf-407f-b44f-cd2a7d3c7f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:49.010697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:49.026023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb04d3a-9bdf-407f-b44f-cd2a7d3c7f7f service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:49.030999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1c9b8-e958-4ff8-b777-775f2c97690f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:49.031614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c9b8-e958-4ff8-b777-775f2c97690f service swift] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:49.031896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c9b8-e958-4ff8-b777-775f2c97690f service swift] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:49.032167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c9b8-e958-4ff8-b777-775f2c97690f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:49.043617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1c9b8-e958-4ff8-b777-775f2c97690f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:49.045349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1c9b8-e958-4ff8-b777-775f2c97690f service swift] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:49.053799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1132/2246] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:18:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 13:18:49.835252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe27e77-15a3-4c1a-8d25-1fa469024714 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:49.836731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9fe27e77-15a3-4c1a-8d25-1fa469024714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:49.906143 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1c9b8-e958-4ff8-b777-775f2c97690f service swift] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:49.910979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-dca1c9b8-e958-4ff8-b777-775f2c97690f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:49.932274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1c9b8-e958-4ff8-b777-775f2c97690f service swift] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:49.938537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731448bf-623b-436d-b575-973321477aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:49.939368 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731448bf-623b-436d-b575-973321477aab service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:49.939807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731448bf-623b-436d-b575-973321477aab service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:49.940381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731448bf-623b-436d-b575-973321477aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:49.942656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-731448bf-623b-436d-b575-973321477aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:49.966453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe27e77-15a3-4c1a-8d25-1fa469024714 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:49.983685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7a01d-803a-44ec-9bed-ea16a9a1902a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:49.984322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a01d-803a-44ec-9bed-ea16a9a1902a service placement] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:49.984597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a01d-803a-44ec-9bed-ea16a9a1902a service placement] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:49.985197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a01d-803a-44ec-9bed-ea16a9a1902a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:49.987458 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-02e7a01d-803a-44ec-9bed-ea16a9a1902a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:50.020011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7a01d-803a-44ec-9bed-ea16a9a1902a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:50.021692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7a01d-803a-44ec-9bed-ea16a9a1902a service placement] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:50.036233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1115/2247] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:50.080329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731448bf-623b-436d-b575-973321477aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:50.082254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731448bf-623b-436d-b575-973321477aab service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:50.104503 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1133/2248] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:50.697580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7a01d-803a-44ec-9bed-ea16a9a1902a service placement] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:50.698844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-02e7a01d-803a-44ec-9bed-ea16a9a1902a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:50.782442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7a01d-803a-44ec-9bed-ea16a9a1902a service placement] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:50.787521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:50.788239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:50.788681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:50.789008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] PATH_INFO: `/v3/users/e8f4daad02e44a8c9b9c42fa2e3fb2ad` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:50.790160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f4daad02e44a8c9b9c42fa2e3fb2ad)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:50.792167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:50.872085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f4daad02e44a8c9b9c42fa2e3fb2ad'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:50.879511 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f4daad02e44a8c9b9c42fa2e3fb2ad'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:50.891455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f4daad02e44a8c9b9c42fa2e3fb2ad'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:50.892441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f4daad02e44a8c9b9c42fa2e3fb2ad'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:50.893175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f4daad02e44a8c9b9c42fa2e3fb2ad'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:50.911663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1116/2249] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:50 2022] DELETE /identity/v3/users/e8f4daad02e44a8c9b9c42fa2e3fb2ad => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:51.097673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731448bf-623b-436d-b575-973321477aab service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:51.110931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731448bf-623b-436d-b575-973321477aab service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:51.176829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:51.177600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:51.177989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:51.178519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] PATH_INFO: `/v3/projects/6c36f5cc9c864ecf825d772f48f87b78` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:51.179743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c36f5cc9c864ecf825d772f48f87b78)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:51.182753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:51.232144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c36f5cc9c864ecf825d772f48f87b78', 'request_id': 'req-e4348f7f-ca25-4ffd-9216-c044e0545d50'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.238326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c36f5cc9c864ecf825d772f48f87b78', 'request_id': 'req-e4348f7f-ca25-4ffd-9216-c044e0545d50'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.245047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c36f5cc9c864ecf825d772f48f87b78', 'request_id': 'req-e4348f7f-ca25-4ffd-9216-c044e0545d50'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.260830 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] The token cache is being invalidate because project 6c36f5cc9c864ecf825d772f48f87b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:51.261123 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.261842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.263421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1134/2250] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:51 2022] DELETE /identity/v3/projects/6c36f5cc9c864ecf825d772f48f87b78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:51.267581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:51.269023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:51.281984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c001533-671a-4ce5-a0e0-962f9e4ff83c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:51.285460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:51.361263 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:51.362096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:51.362377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:51.362653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] PATH_INFO: `/v3/users/4b4ccc0a5b324ebbaf1ca1f9f94cac91` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:51.363819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4ccc0a5b324ebbaf1ca1f9f94cac91)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:51.365929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:51.427241 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4ccc0a5b324ebbaf1ca1f9f94cac91'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.434641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4ccc0a5b324ebbaf1ca1f9f94cac91'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.447154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4ccc0a5b324ebbaf1ca1f9f94cac91'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.447900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4ccc0a5b324ebbaf1ca1f9f94cac91'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.448537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e03a688c-c01f-4bf3-88ea-d4564a0376d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4ccc0a5b324ebbaf1ca1f9f94cac91'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.462632 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1117/2251] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:18:51 2022] DELETE /identity/v3/users/4b4ccc0a5b324ebbaf1ca1f9f94cac91 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:51.738192 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:51.745133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:51.780513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4348f7f-ca25-4ffd-9216-c044e0545d50 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:51.807755 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:51.871944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:51.872640 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:51.872925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:51.873204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] PATH_INFO: `/v3/projects/70df542eaf7045c2ace23d5ff5cd3d6f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:51.874400 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70df542eaf7045c2ace23d5ff5cd3d6f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:51.876530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:51.971486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70df542eaf7045c2ace23d5ff5cd3d6f', 'request_id': 'req-eb2a5bce-414d-4bc8-978a-06a58923cfb4'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.977625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70df542eaf7045c2ace23d5ff5cd3d6f', 'request_id': 'req-eb2a5bce-414d-4bc8-978a-06a58923cfb4'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:51.992893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70df542eaf7045c2ace23d5ff5cd3d6f', 'request_id': 'req-eb2a5bce-414d-4bc8-978a-06a58923cfb4'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:52.016465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] The token cache is being invalidate because project 70df542eaf7045c2ace23d5ff5cd3d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:18:52.019067 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:52.021310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-eb2a5bce-414d-4bc8-978a-06a58923cfb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:18:52.023251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1135/2252] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:18:51 2022] DELETE /identity/v3/projects/70df542eaf7045c2ace23d5ff5cd3d6f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:52.028395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be47cd-4578-47aa-8b1e-5e46a23e237b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.028845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be47cd-4578-47aa-8b1e-5e46a23e237b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.029265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be47cd-4578-47aa-8b1e-5e46a23e237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.050192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f3be47cd-4578-47aa-8b1e-5e46a23e237b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:52.051782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f3be47cd-4578-47aa-8b1e-5e46a23e237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:52.149415 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1118/2253] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:52.157743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f648c-db71-429c-ae0b-43dd6d66ba91 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.158782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f648c-db71-429c-ae0b-43dd6d66ba91 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.159242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f648c-db71-429c-ae0b-43dd6d66ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.180883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-1c4f648c-db71-429c-ae0b-43dd6d66ba91 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:52.182372 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1c4f648c-db71-429c-ae0b-43dd6d66ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:52.191441 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1136/2254] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:52.195488 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be47cd-4578-47aa-8b1e-5e46a23e237b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:52.205283 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be47cd-4578-47aa-8b1e-5e46a23e237b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:52.210159 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e035d-2548-44fb-b885-315b2629f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:52.210804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e035d-2548-44fb-b885-315b2629f8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.211249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e035d-2548-44fb-b885-315b2629f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.211604 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e035d-2548-44fb-b885-315b2629f8c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.212281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e035d-2548-44fb-b885-315b2629f8c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:18:52.212613 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e035d-2548-44fb-b885-315b2629f8c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:52.214485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e035d-2548-44fb-b885-315b2629f8c2 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:52.232378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1119/2255] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:18:52.237824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f648c-db71-429c-ae0b-43dd6d66ba91 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:52.250275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f648c-db71-429c-ae0b-43dd6d66ba91 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:52.265722 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1ab50-990f-4b79-9339-f7b266fb840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:52.267146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1ab50-990f-4b79-9339-f7b266fb840a admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.267581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1ab50-990f-4b79-9339-f7b266fb840a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.268284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1ab50-990f-4b79-9339-f7b266fb840a admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.269408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1ab50-990f-4b79-9339-f7b266fb840a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:52.271850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1ab50-990f-4b79-9339-f7b266fb840a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:52.303405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1137/2256] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:52 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:52.308120 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e035d-2548-44fb-b885-315b2629f8c2 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:52.319401 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e035d-2548-44fb-b885-315b2629f8c2 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:52.330739 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:52.391737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fa322-c8c2-47ad-8a4b-35ba0533d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:52.392386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fa322-c8c2-47ad-8a4b-35ba0533d65c admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.392664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fa322-c8c2-47ad-8a4b-35ba0533d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.392931 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fa322-c8c2-47ad-8a4b-35ba0533d65c admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.393568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fa322-c8c2-47ad-8a4b-35ba0533d65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:52.395511 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fa322-c8c2-47ad-8a4b-35ba0533d65c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:52.422055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1120/2257] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:52 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:52.426661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1ab50-990f-4b79-9339-f7b266fb840a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:52.438460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1ab50-990f-4b79-9339-f7b266fb840a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:52.443360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5fe8-3e68-4b3f-a090-b468d8291fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:52.444049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5fe8-3e68-4b3f-a090-b468d8291fde admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.444421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5fe8-3e68-4b3f-a090-b468d8291fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.444769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5fe8-3e68-4b3f-a090-b468d8291fde admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.445428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be5fe8-3e68-4b3f-a090-b468d8291fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:52.447039 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be5fe8-3e68-4b3f-a090-b468d8291fde admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:52.458733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1138/2258] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:52.462736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fa322-c8c2-47ad-8a4b-35ba0533d65c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:52.473298 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fa322-c8c2-47ad-8a4b-35ba0533d65c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:52.477965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2aff7-62dc-4d91-9878-413880e946ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:52.478601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2aff7-62dc-4d91-9878-413880e946ae admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.478882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2aff7-62dc-4d91-9878-413880e946ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.479153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2aff7-62dc-4d91-9878-413880e946ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.479799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2aff7-62dc-4d91-9878-413880e946ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:52.481487 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2aff7-62dc-4d91-9878-413880e946ae admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:52.492607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1121/2259] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:18:52.496934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5fe8-3e68-4b3f-a090-b468d8291fde admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:52.507746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5fe8-3e68-4b3f-a090-b468d8291fde admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:52.513494 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adf6a2-1282-4a31-849a-bf5b7ae61d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:52.514329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adf6a2-1282-4a31-849a-bf5b7ae61d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.514609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adf6a2-1282-4a31-849a-bf5b7ae61d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.514885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adf6a2-1282-4a31-849a-bf5b7ae61d6e admin admin] PATH_INFO: `/v3/projects/4d995bacca104affba9f19b56ce809e9/users/ad9f149a2a1142308f0505bfcd7bc583/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.533283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adf6a2-1282-4a31-849a-bf5b7ae61d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d995bacca104affba9f19b56ce809e9, user_id=ad9f149a2a1142308f0505bfcd7bc583, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:52.536842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adf6a2-1282-4a31-849a-bf5b7ae61d6e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:52.561012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1139/2260] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:52 2022] PUT /identity/v3/projects/4d995bacca104affba9f19b56ce809e9/users/ad9f149a2a1142308f0505bfcd7bc583/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:52.567924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbb002-6c1f-4f51-88ca-ec5ef27d8cc7 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.568214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbb002-6c1f-4f51-88ca-ec5ef27d8cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.568497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbb002-6c1f-4f51-88ca-ec5ef27d8cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.598579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-92bbb002-6c1f-4f51-88ca-ec5ef27d8cc7 None None] MFA Rules not processed for user `ad9f149a2a1142308f0505bfcd7bc583`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:52.599939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-92bbb002-6c1f-4f51-88ca-ec5ef27d8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:52.698114 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1122/2261] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:52.703261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adf6a2-1282-4a31-849a-bf5b7ae61d6e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:52.764531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:52.786529 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adf6a2-1282-4a31-849a-bf5b7ae61d6e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:52.793416 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66570fb-e581-4293-be1a-baeddb7954b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:52.794582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66570fb-e581-4293-be1a-baeddb7954b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.795705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66570fb-e581-4293-be1a-baeddb7954b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.796070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66570fb-e581-4293-be1a-baeddb7954b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.797325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66570fb-e581-4293-be1a-baeddb7954b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:52.800494 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66570fb-e581-4293-be1a-baeddb7954b2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:52.864823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1140/2262] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:52 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:18:52.877344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbb002-6c1f-4f51-88ca-ec5ef27d8cc7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:52.890789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbb002-6c1f-4f51-88ca-ec5ef27d8cc7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:52.949284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee8c3-bd1a-438d-8cfd-893a71e11cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:52.950109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee8c3-bd1a-438d-8cfd-893a71e11cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.950387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee8c3-bd1a-438d-8cfd-893a71e11cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:52.950814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee8c3-bd1a-438d-8cfd-893a71e11cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:52.951446 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ee8c3-bd1a-438d-8cfd-893a71e11cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:52.953420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ee8c3-bd1a-438d-8cfd-893a71e11cf2 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:52.976089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1123/2263] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:52 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:52.980164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66570fb-e581-4293-be1a-baeddb7954b2 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:52.992058 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66570fb-e581-4293-be1a-baeddb7954b2 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:52.998051 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bdb6f-747c-475d-bf43-5842e311f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:52.998685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bdb6f-747c-475d-bf43-5842e311f7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:52.998907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bdb6f-747c-475d-bf43-5842e311f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.000456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bdb6f-747c-475d-bf43-5842e311f7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.001135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bdb6f-747c-475d-bf43-5842e311f7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:53.002836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bdb6f-747c-475d-bf43-5842e311f7a1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:53.020189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1141/2264] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:18:53.021483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee8c3-bd1a-438d-8cfd-893a71e11cf2 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:53.032050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee8c3-bd1a-438d-8cfd-893a71e11cf2 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:53.036845 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dfe49-bb1f-4ff7-ad71-637b38a6a402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:53.037733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dfe49-bb1f-4ff7-ad71-637b38a6a402 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:53.037733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dfe49-bb1f-4ff7-ad71-637b38a6a402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.037983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dfe49-bb1f-4ff7-ad71-637b38a6a402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.038627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dfe49-bb1f-4ff7-ad71-637b38a6a402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:53.040244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dfe49-bb1f-4ff7-ad71-637b38a6a402 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:53.046160 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:53.054741 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1124/2265] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:53.055929 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bdb6f-747c-475d-bf43-5842e311f7a1 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:53.066405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bdb6f-747c-475d-bf43-5842e311f7a1 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:53.071147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30403e6f-64fc-47d8-a26d-dacb429f2672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:53.071823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30403e6f-64fc-47d8-a26d-dacb429f2672 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:53.072138 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30403e6f-64fc-47d8-a26d-dacb429f2672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.072437 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30403e6f-64fc-47d8-a26d-dacb429f2672 admin admin] PATH_INFO: `/v3/projects/77db5043a8cc4272abf39dca60fa1de8/users/4de23132f5ab46a3a0f760472fdb513e/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.087598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30403e6f-64fc-47d8-a26d-dacb429f2672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77db5043a8cc4272abf39dca60fa1de8, user_id=4de23132f5ab46a3a0f760472fdb513e, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:53.090383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30403e6f-64fc-47d8-a26d-dacb429f2672 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:53.104530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1142/2266] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:53 2022] PUT /identity/v3/projects/77db5043a8cc4272abf39dca60fa1de8/users/4de23132f5ab46a3a0f760472fdb513e/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:18:53.173555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8315f-ff39-4a00-931c-5190134b2152 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:53.173842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8315f-ff39-4a00-931c-5190134b2152 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.174182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8315f-ff39-4a00-931c-5190134b2152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.204753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1cb8315f-ff39-4a00-931c-5190134b2152 None None] MFA Rules not processed for user `4de23132f5ab46a3a0f760472fdb513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:53.206229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1cb8315f-ff39-4a00-931c-5190134b2152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:53.321600 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1125/2267] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:53.322935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30403e6f-64fc-47d8-a26d-dacb429f2672 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:53.409925 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30403e6f-64fc-47d8-a26d-dacb429f2672 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:53.421990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516eca8-1b4e-45b6-b6a2-bc0adbe63639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:53.422923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516eca8-1b4e-45b6-b6a2-bc0adbe63639 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:53.423349 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516eca8-1b4e-45b6-b6a2-bc0adbe63639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.423973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516eca8-1b4e-45b6-b6a2-bc0adbe63639 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.424557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516eca8-1b4e-45b6-b6a2-bc0adbe63639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:53.426799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516eca8-1b4e-45b6-b6a2-bc0adbe63639 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:53.470691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1143/2268] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:18:53 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:53.475391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8315f-ff39-4a00-931c-5190134b2152 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:53.511126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8315f-ff39-4a00-931c-5190134b2152 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:53.589244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301b2d9-71b0-4a67-9f97-ec64031cee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:53.590025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b2d9-71b0-4a67-9f97-ec64031cee46 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:53.590530 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b2d9-71b0-4a67-9f97-ec64031cee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.590870 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b2d9-71b0-4a67-9f97-ec64031cee46 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.591701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301b2d9-71b0-4a67-9f97-ec64031cee46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:53.593738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301b2d9-71b0-4a67-9f97-ec64031cee46 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:53.635495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1126/2269] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:18:53 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:18:53.638177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516eca8-1b4e-45b6-b6a2-bc0adbe63639 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:53.650438 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516eca8-1b4e-45b6-b6a2-bc0adbe63639 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:53.656032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca0995-c6d0-4770-89f2-c3af06117ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:53.657598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca0995-c6d0-4770-89f2-c3af06117ddc admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:53.658144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca0995-c6d0-4770-89f2-c3af06117ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.658688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca0995-c6d0-4770-89f2-c3af06117ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.659780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca0995-c6d0-4770-89f2-c3af06117ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:53.661854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca0995-c6d0-4770-89f2-c3af06117ddc admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:53.679195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1144/2270] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:53.680891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301b2d9-71b0-4a67-9f97-ec64031cee46 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:53.691574 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301b2d9-71b0-4a67-9f97-ec64031cee46 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:53.699969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798aa02-694a-468c-9569-395ca011f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:53.700808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798aa02-694a-468c-9569-395ca011f7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:53.701094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798aa02-694a-468c-9569-395ca011f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.701361 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798aa02-694a-468c-9569-395ca011f7f9 admin admin] PATH_INFO: `/v3/projects/3551d84ee5c34af5aae7ee3aacd21a6e/users/9597b2cceb7c4c8db2760042337dbbad/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.717073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798aa02-694a-468c-9569-395ca011f7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3551d84ee5c34af5aae7ee3aacd21a6e, user_id=9597b2cceb7c4c8db2760042337dbbad, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:53.719813 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798aa02-694a-468c-9569-395ca011f7f9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:53.735661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1127/2271] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:53 2022] PUT /identity/v3/projects/3551d84ee5c34af5aae7ee3aacd21a6e/users/9597b2cceb7c4c8db2760042337dbbad/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:53.739820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca0995-c6d0-4770-89f2-c3af06117ddc admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:53.751124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca0995-c6d0-4770-89f2-c3af06117ddc admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:53.814903 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf20007-1031-4e2a-a476-3698ee1ec5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:53.815588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf20007-1031-4e2a-a476-3698ee1ec5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:53.815873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf20007-1031-4e2a-a476-3698ee1ec5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.816146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf20007-1031-4e2a-a476-3698ee1ec5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.817220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf20007-1031-4e2a-a476-3698ee1ec5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:53.818863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf20007-1031-4e2a-a476-3698ee1ec5ad admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:53.834568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1145/2272] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:18:53.836272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798aa02-694a-468c-9569-395ca011f7f9 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:53.854689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798aa02-694a-468c-9569-395ca011f7f9 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:53.860956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4051b9-d5f7-4a94-ac1d-915c0da60d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:53.861639 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4051b9-d5f7-4a94-ac1d-915c0da60d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:53.861920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4051b9-d5f7-4a94-ac1d-915c0da60d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.862196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4051b9-d5f7-4a94-ac1d-915c0da60d22 admin admin] PATH_INFO: `/v3/projects/3551d84ee5c34af5aae7ee3aacd21a6e/users/9597b2cceb7c4c8db2760042337dbbad/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.864143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4051b9-d5f7-4a94-ac1d-915c0da60d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3551d84ee5c34af5aae7ee3aacd21a6e, user_id=9597b2cceb7c4c8db2760042337dbbad, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:53.866907 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4051b9-d5f7-4a94-ac1d-915c0da60d22 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:53.878953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1128/2273] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:18:53 2022] PUT /identity/v3/projects/3551d84ee5c34af5aae7ee3aacd21a6e/users/9597b2cceb7c4c8db2760042337dbbad/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:18:53.889329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94e06-a4aa-4e97-86b2-f2bdc785c221 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:53.889611 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94e06-a4aa-4e97-86b2-f2bdc785c221 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:53.889880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94e06-a4aa-4e97-86b2-f2bdc785c221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:53.897489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:53.923480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c5b94e06-a4aa-4e97-86b2-f2bdc785c221 None None] MFA Rules not processed for user `9597b2cceb7c4c8db2760042337dbbad`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:18:53.924752 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c5b94e06-a4aa-4e97-86b2-f2bdc785c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:54.008052 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1146/2274] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:18:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:18:54.021734 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4051b9-d5f7-4a94-ac1d-915c0da60d22 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:54.023543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-eb4051b9-d5f7-4a94-ac1d-915c0da60d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:18:54.096630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:54.109379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4051b9-d5f7-4a94-ac1d-915c0da60d22 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:54.113425 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9647e-f6fa-41b3-82f0-c92db7e3679c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:54.114031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9647e-f6fa-41b3-82f0-c92db7e3679c service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:54.114311 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9647e-f6fa-41b3-82f0-c92db7e3679c service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:54.114583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9647e-f6fa-41b3-82f0-c92db7e3679c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:54.183333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9647e-f6fa-41b3-82f0-c92db7e3679c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:54.185070 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9647e-f6fa-41b3-82f0-c92db7e3679c service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:54.196333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1129/2275] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:55.757595 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b94e06-a4aa-4e97-86b2-f2bdc785c221 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:55.767275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b94e06-a4aa-4e97-86b2-f2bdc785c221 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:55.770960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375dd12-a69e-4441-8db5-e608304ea7d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:55.771568 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375dd12-a69e-4441-8db5-e608304ea7d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:55.771844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375dd12-a69e-4441-8db5-e608304ea7d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:55.772113 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375dd12-a69e-4441-8db5-e608304ea7d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:55.863881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375dd12-a69e-4441-8db5-e608304ea7d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:55.865931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375dd12-a69e-4441-8db5-e608304ea7d7 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:55.879072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1147/2276] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:18:56.571517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9647e-f6fa-41b3-82f0-c92db7e3679c service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:18:56.580344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9647e-f6fa-41b3-82f0-c92db7e3679c service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:18:56.584523 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a8d95-0c68-4d81-8ead-02f704ef3a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:18:56.585116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a8d95-0c68-4d81-8ead-02f704ef3a5b service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:18:56.585390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a8d95-0c68-4d81-8ead-02f704ef3a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:18:56.585713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a8d95-0c68-4d81-8ead-02f704ef3a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:18:56.594512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a8d95-0c68-4d81-8ead-02f704ef3a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:18:56.595916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a8d95-0c68-4d81-8ead-02f704ef3a5b service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:18:56.605409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1130/2277] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:18:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:00.567450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375dd12-a69e-4441-8db5-e608304ea7d7 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:00.644734 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375dd12-a69e-4441-8db5-e608304ea7d7 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:00.649496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:00.650135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:00.650415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:00.650826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] PATH_INFO: `/v3/users/ad9f149a2a1142308f0505bfcd7bc583` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:00.652072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9f149a2a1142308f0505bfcd7bc583)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:00.654150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:00.686028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:00.711077 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9f149a2a1142308f0505bfcd7bc583'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:00.718524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9f149a2a1142308f0505bfcd7bc583'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:00.719198 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9f149a2a1142308f0505bfcd7bc583'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:00.732194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9f149a2a1142308f0505bfcd7bc583'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:00.732909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9f149a2a1142308f0505bfcd7bc583'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:00.747027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1148/2278] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:00 2022] DELETE /identity/v3/users/ad9f149a2a1142308f0505bfcd7bc583 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:00.751824 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678ef59-568e-491c-b57c-91d9284ddd6b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:00.752403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678ef59-568e-491c-b57c-91d9284ddd6b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:00.752509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678ef59-568e-491c-b57c-91d9284ddd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:00.772148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e678ef59-568e-491c-b57c-91d9284ddd6b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:00.773695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e678ef59-568e-491c-b57c-91d9284ddd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:00.838529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1131/2279] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:00.848910 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:00.850507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:00.913634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797baf97-28d4-424b-bbd6-55ab5c70285c admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:00.917325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eadecf-0762-49f6-84ec-f7201be60757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:00.917941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eadecf-0762-49f6-84ec-f7201be60757 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:00.918220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eadecf-0762-49f6-84ec-f7201be60757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:00.918493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eadecf-0762-49f6-84ec-f7201be60757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:00.933854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eadecf-0762-49f6-84ec-f7201be60757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:00.935402 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eadecf-0762-49f6-84ec-f7201be60757 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:00.945258 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1149/2280] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:01.217613 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678ef59-568e-491c-b57c-91d9284ddd6b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:01.219108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e678ef59-568e-491c-b57c-91d9284ddd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:01.232560 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678ef59-568e-491c-b57c-91d9284ddd6b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:01.238255 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:01.238911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:01.239209 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:01.239451 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] PATH_INFO: `/v3/projects/4d995bacca104affba9f19b56ce809e9` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:01.241032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d995bacca104affba9f19b56ce809e9)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:01.242992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:01.295025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d995bacca104affba9f19b56ce809e9', 'request_id': 'req-e54c3e22-20ba-4655-8178-be48721e48d5'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.302647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d995bacca104affba9f19b56ce809e9', 'request_id': 'req-e54c3e22-20ba-4655-8178-be48721e48d5'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.310607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d995bacca104affba9f19b56ce809e9', 'request_id': 'req-e54c3e22-20ba-4655-8178-be48721e48d5'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.327953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] The token cache is being invalidate because project 4d995bacca104affba9f19b56ce809e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:01.328267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.329414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.331323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1132/2281] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:01 2022] DELETE /identity/v3/projects/4d995bacca104affba9f19b56ce809e9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:01.336478 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eadecf-0762-49f6-84ec-f7201be60757 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:01.347140 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eadecf-0762-49f6-84ec-f7201be60757 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:01.406379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:01.407061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:01.407339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:01.407633 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] PATH_INFO: `/v3/users/4de23132f5ab46a3a0f760472fdb513e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:01.408930 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de23132f5ab46a3a0f760472fdb513e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:01.410935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:01.462312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de23132f5ab46a3a0f760472fdb513e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.464636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:01.471095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de23132f5ab46a3a0f760472fdb513e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.471838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de23132f5ab46a3a0f760472fdb513e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.486807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de23132f5ab46a3a0f760472fdb513e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.487530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de23132f5ab46a3a0f760472fdb513e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.502225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1150/2282] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:01 2022] DELETE /identity/v3/users/4de23132f5ab46a3a0f760472fdb513e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:01.769848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:01.771774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:01.786842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c3e22-20ba-4655-8178-be48721e48d5 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:01.791778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:01.858930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:01.859958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:01.860239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:01.860538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] PATH_INFO: `/v3/projects/77db5043a8cc4272abf39dca60fa1de8` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:01.861714 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77db5043a8cc4272abf39dca60fa1de8)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:01.863638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:01.912456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77db5043a8cc4272abf39dca60fa1de8', 'request_id': 'req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.922060 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77db5043a8cc4272abf39dca60fa1de8', 'request_id': 'req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.928831 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77db5043a8cc4272abf39dca60fa1de8', 'request_id': 'req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.939227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] The token cache is being invalidate because project 77db5043a8cc4272abf39dca60fa1de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:01.939564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.940144 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:01.941720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1133/2283] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:01 2022] DELETE /identity/v3/projects/77db5043a8cc4272abf39dca60fa1de8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:01.945787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:01.947200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:01.959704 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc781b0-82e1-4fcd-bda5-d665fe1ffdb8 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:02.021808 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:02.022448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:02.022725 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:02.023019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] PATH_INFO: `/v3/users/9597b2cceb7c4c8db2760042337dbbad` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:02.024181 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9597b2cceb7c4c8db2760042337dbbad)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:02.026134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:02.076967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9597b2cceb7c4c8db2760042337dbbad'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:02.084374 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9597b2cceb7c4c8db2760042337dbbad'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:02.085056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9597b2cceb7c4c8db2760042337dbbad'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:02.097723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9597b2cceb7c4c8db2760042337dbbad'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:02.098439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2214ffb0-f969-42cb-b751-7944a75a643c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9597b2cceb7c4c8db2760042337dbbad'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:02.115480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1151/2284] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:01 2022] DELETE /identity/v3/users/9597b2cceb7c4c8db2760042337dbbad => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:02.518067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:02.519589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:02.533036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8bcfd-2518-4d82-ad7c-6b9cbd7e9d99 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:02.601347 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:02.601977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:02.602252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:02.602495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] PATH_INFO: `/v3/projects/3551d84ee5c34af5aae7ee3aacd21a6e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:02.603759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3551d84ee5c34af5aae7ee3aacd21a6e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:02.605723 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:02.648400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:02.657042 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3551d84ee5c34af5aae7ee3aacd21a6e', 'request_id': 'req-19079b61-82df-4a8c-bd9c-2041d0112fca'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:02.665244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3551d84ee5c34af5aae7ee3aacd21a6e', 'request_id': 'req-19079b61-82df-4a8c-bd9c-2041d0112fca'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:02.671776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3551d84ee5c34af5aae7ee3aacd21a6e', 'request_id': 'req-19079b61-82df-4a8c-bd9c-2041d0112fca'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:02.682758 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] The token cache is being invalidate because project 3551d84ee5c34af5aae7ee3aacd21a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:02.683049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:02.683681 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-19079b61-82df-4a8c-bd9c-2041d0112fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:02.685266 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1134/2285] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:02 2022] DELETE /identity/v3/projects/3551d84ee5c34af5aae7ee3aacd21a6e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:02.691763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebceb73-8667-4e42-967b-b93618ea85bb None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:02.692121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebceb73-8667-4e42-967b-b93618ea85bb None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:02.692493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebceb73-8667-4e42-967b-b93618ea85bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:02.713275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4ebceb73-8667-4e42-967b-b93618ea85bb None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:02.714424 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4ebceb73-8667-4e42-967b-b93618ea85bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:02.758880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:02.779394 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1152/2286] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:19:02.788835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6106c3-1b93-4e3d-a9b3-b132a33d2205 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:02.789373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6106c3-1b93-4e3d-a9b3-b132a33d2205 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:02.789373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6106c3-1b93-4e3d-a9b3-b132a33d2205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:02.809930 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-0f6106c3-1b93-4e3d-a9b3-b132a33d2205 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:02.811135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0f6106c3-1b93-4e3d-a9b3-b132a33d2205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:02.820934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1135/2287] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:02.825825 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebceb73-8667-4e42-967b-b93618ea85bb None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:02.835963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebceb73-8667-4e42-967b-b93618ea85bb None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:02.841481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249a298-5527-445d-afa8-4d7096d777cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:02.842101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249a298-5527-445d-afa8-4d7096d777cb admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:02.842613 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249a298-5527-445d-afa8-4d7096d777cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:02.842875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249a298-5527-445d-afa8-4d7096d777cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:02.843573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249a298-5527-445d-afa8-4d7096d777cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:19:02.843875 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249a298-5527-445d-afa8-4d7096d777cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:02.845533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249a298-5527-445d-afa8-4d7096d777cb admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:02.857972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1153/2288] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:19:02.863089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6106c3-1b93-4e3d-a9b3-b132a33d2205 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:02.872675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6106c3-1b93-4e3d-a9b3-b132a33d2205 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:02.877834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec8b3f-94b5-4b7a-9afc-53b3f30ef34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:02.878438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec8b3f-94b5-4b7a-9afc-53b3f30ef34a admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:02.878715 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec8b3f-94b5-4b7a-9afc-53b3f30ef34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:02.878998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec8b3f-94b5-4b7a-9afc-53b3f30ef34a admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:02.879621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec8b3f-94b5-4b7a-9afc-53b3f30ef34a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:02.881615 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec8b3f-94b5-4b7a-9afc-53b3f30ef34a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:02.910678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1136/2289] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:02 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:02.915011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249a298-5527-445d-afa8-4d7096d777cb admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:02.925643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249a298-5527-445d-afa8-4d7096d777cb admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:02.984121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75a314-adba-4efe-9c27-a4460d8c1bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:02.985136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75a314-adba-4efe-9c27-a4460d8c1bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:02.985281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75a314-adba-4efe-9c27-a4460d8c1bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:02.985577 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75a314-adba-4efe-9c27-a4460d8c1bfc admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:02.986207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75a314-adba-4efe-9c27-a4460d8c1bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:02.988137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75a314-adba-4efe-9c27-a4460d8c1bfc admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:03.009764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1154/2290] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:02 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:03.013882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec8b3f-94b5-4b7a-9afc-53b3f30ef34a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:03.024118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec8b3f-94b5-4b7a-9afc-53b3f30ef34a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:03.029322 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba368f-183f-4de5-82a9-302f54c66c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:03.029911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba368f-183f-4de5-82a9-302f54c66c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:03.030187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba368f-183f-4de5-82a9-302f54c66c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:03.030459 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba368f-183f-4de5-82a9-302f54c66c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:03.031129 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba368f-183f-4de5-82a9-302f54c66c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:03.032771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba368f-183f-4de5-82a9-302f54c66c18 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:03.042944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1137/2291] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:03.046935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75a314-adba-4efe-9c27-a4460d8c1bfc admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:03.057485 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75a314-adba-4efe-9c27-a4460d8c1bfc admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:03.063115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd921ef-413d-4bae-91ec-7d2f3dfd6d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:03.063710 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd921ef-413d-4bae-91ec-7d2f3dfd6d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:03.064022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd921ef-413d-4bae-91ec-7d2f3dfd6d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:03.064285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd921ef-413d-4bae-91ec-7d2f3dfd6d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:03.064957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd921ef-413d-4bae-91ec-7d2f3dfd6d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:03.066556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd921ef-413d-4bae-91ec-7d2f3dfd6d89 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:03.077377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1155/2292] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:03.081536 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba368f-183f-4de5-82a9-302f54c66c18 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:03.091727 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba368f-183f-4de5-82a9-302f54c66c18 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:03.097646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bba48-12e3-4f47-8f6f-46a2891b31bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:03.098198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bba48-12e3-4f47-8f6f-46a2891b31bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:03.098495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bba48-12e3-4f47-8f6f-46a2891b31bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:03.098726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bba48-12e3-4f47-8f6f-46a2891b31bd admin admin] PATH_INFO: `/v3/projects/1e9f37b1681d4a47b663293773bddc26/users/bd0427fedb3c4241a6e4fd216d1ebd36/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:03.115974 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bba48-12e3-4f47-8f6f-46a2891b31bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9f37b1681d4a47b663293773bddc26, user_id=bd0427fedb3c4241a6e4fd216d1ebd36, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:03.118680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bba48-12e3-4f47-8f6f-46a2891b31bd admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:03.133671 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1138/2293] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:03 2022] PUT /identity/v3/projects/1e9f37b1681d4a47b663293773bddc26/users/bd0427fedb3c4241a6e4fd216d1ebd36/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:03.144068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7ccbe-2183-44e8-bd4e-420bf5b5d57b None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:03.144390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7ccbe-2183-44e8-bd4e-420bf5b5d57b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:03.144665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7ccbe-2183-44e8-bd4e-420bf5b5d57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:03.172003 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-d8b7ccbe-2183-44e8-bd4e-420bf5b5d57b None None] MFA Rules not processed for user `bd0427fedb3c4241a6e4fd216d1ebd36`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:03.173248 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d8b7ccbe-2183-44e8-bd4e-420bf5b5d57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:03.243119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1156/2294] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:03.254959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bba48-12e3-4f47-8f6f-46a2891b31bd admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:03.256879 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0a7bba48-12e3-4f47-8f6f-46a2891b31bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:03.315547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bba48-12e3-4f47-8f6f-46a2891b31bd admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:03.319753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ea838-c906-4885-b3ad-aabec06f8e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:03.320382 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ea838-c906-4885-b3ad-aabec06f8e33 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:03.320663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ea838-c906-4885-b3ad-aabec06f8e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:03.320932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ea838-c906-4885-b3ad-aabec06f8e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:03.330209 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ea838-c906-4885-b3ad-aabec06f8e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:03.331678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ea838-c906-4885-b3ad-aabec06f8e33 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:03.341293 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1139/2295] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:05.443828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013c6a-642e-4e3b-aa74-a01c70115d1b None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:05.444374 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013c6a-642e-4e3b-aa74-a01c70115d1b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:05.445049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013c6a-642e-4e3b-aa74-a01c70115d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:05.469093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-ff013c6a-642e-4e3b-aa74-a01c70115d1b None None] MFA Rules not processed for user `2ce014df3a294fa5bb209b40f889069f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:05.470302 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ff013c6a-642e-4e3b-aa74-a01c70115d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:05.509688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:05.527888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1157/2296] 10.222.0.15 () {58 vars in 967 bytes} [Mon Oct 24 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:05.541294 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ea838-c906-4885-b3ad-aabec06f8e33 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:05.542822 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-116ea838-c906-4885-b3ad-aabec06f8e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:05.615233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ea838-c906-4885-b3ad-aabec06f8e33 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:05.621125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e357f-e156-4128-b308-a1ce4450e988 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1fbb5f8a384aac98e17bd622e25eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:05.621732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e357f-e156-4128-b308-a1ce4450e988 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:05.622027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e357f-e156-4128-b308-a1ce4450e988 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:05.622289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e357f-e156-4128-b308-a1ce4450e988 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:05.628915 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:05.631324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e357f-e156-4128-b308-a1ce4450e988 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:05.633436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e357f-e156-4128-b308-a1ce4450e988 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:05.642670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1140/2297] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Oct 24 13:19:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:10.691489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff013c6a-642e-4e3b-aa74-a01c70115d1b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:10.693170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ff013c6a-642e-4e3b-aa74-a01c70115d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:10.760458 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff013c6a-642e-4e3b-aa74-a01c70115d1b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:10.765645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:10.766269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:10.766558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:10.766828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] PATH_INFO: `/v3/users/e8a4344d5f0640929b48c7f586186bd0` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:10.768015 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a4344d5f0640929b48c7f586186bd0)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:10.769998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:10.819277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a4344d5f0640929b48c7f586186bd0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:10.826125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a4344d5f0640929b48c7f586186bd0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:10.826828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a4344d5f0640929b48c7f586186bd0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:10.839313 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a4344d5f0640929b48c7f586186bd0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:10.840041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a4344d5f0640929b48c7f586186bd0'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:10.854883 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1158/2298] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:10 2022] DELETE /identity/v3/users/e8a4344d5f0640929b48c7f586186bd0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:10.859805 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee99d25-7ba4-404a-8aa7-48b493d22c9c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:10.860335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee99d25-7ba4-404a-8aa7-48b493d22c9c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:10.860436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee99d25-7ba4-404a-8aa7-48b493d22c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:10.879323 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-6ee99d25-7ba4-404a-8aa7-48b493d22c9c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:10.880471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6ee99d25-7ba4-404a-8aa7-48b493d22c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:10.940701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1141/2299] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:10.950839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:10.952544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:11.013029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55266439-9abd-4a9a-9874-26a0d6bf02ad admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.017034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e278bd8-4edd-4f40-818c-a6f8c03bd0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.017641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e278bd8-4edd-4f40-818c-a6f8c03bd0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.017928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e278bd8-4edd-4f40-818c-a6f8c03bd0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.018203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e278bd8-4edd-4f40-818c-a6f8c03bd0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.027574 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e278bd8-4edd-4f40-818c-a6f8c03bd0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.029130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e278bd8-4edd-4f40-818c-a6f8c03bd0a2 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.038770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1159/2300] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:11.313072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee99d25-7ba4-404a-8aa7-48b493d22c9c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.314653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6ee99d25-7ba4-404a-8aa7-48b493d22c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:11.326708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee99d25-7ba4-404a-8aa7-48b493d22c9c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.331874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.332531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.332802 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.333067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] PATH_INFO: `/v3/projects/b4d3e2b1323d4aab9ef408c31f54026c` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.334397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d3e2b1323d4aab9ef408c31f54026c)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.336167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.389677 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d3e2b1323d4aab9ef408c31f54026c', 'request_id': 'req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.399263 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d3e2b1323d4aab9ef408c31f54026c', 'request_id': 'req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.405839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d3e2b1323d4aab9ef408c31f54026c', 'request_id': 'req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.415774 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] The token cache is being invalidate because project b4d3e2b1323d4aab9ef408c31f54026c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:11.416055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.416683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.418167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1142/2301] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:11 2022] DELETE /identity/v3/projects/b4d3e2b1323d4aab9ef408c31f54026c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:11.422334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e278bd8-4edd-4f40-818c-a6f8c03bd0a2 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.431736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e278bd8-4edd-4f40-818c-a6f8c03bd0a2 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.439382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:11.497840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.498624 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.499000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.499371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] PATH_INFO: `/v3/users/445e545e903f4827ad7ad47ac71991bd` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.500630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445e545e903f4827ad7ad47ac71991bd)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.502573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:11.555067 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445e545e903f4827ad7ad47ac71991bd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.562102 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445e545e903f4827ad7ad47ac71991bd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.562764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445e545e903f4827ad7ad47ac71991bd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.575409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445e545e903f4827ad7ad47ac71991bd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.576151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-cdf7fd7e-6a2f-463d-a493-da64ec27f8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445e545e903f4827ad7ad47ac71991bd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:11.589586 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1160/2302] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:11 2022] DELETE /identity/v3/users/445e545e903f4827ad7ad47ac71991bd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:11.882116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:11.883561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:11.898406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3ee8b-ba00-49c3-8cc3-17b5985983a8 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:11.967764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:11.968437 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:11.968718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:11.968991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] PATH_INFO: `/v3/projects/82f810c4f73d49d787de3b44e389bf85` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:11.970112 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f810c4f73d49d787de3b44e389bf85)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:11.972962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.005698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:12.032458 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f810c4f73d49d787de3b44e389bf85', 'request_id': 'req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:12.040965 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f810c4f73d49d787de3b44e389bf85', 'request_id': 'req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:12.047526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f810c4f73d49d787de3b44e389bf85', 'request_id': 'req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:12.057763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] The token cache is being invalidate because project 82f810c4f73d49d787de3b44e389bf85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:12.058046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:12.058674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f5063f24-7f4f-405e-9bf7-312e1ed95ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:12.060200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1143/2303] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:11 2022] DELETE /identity/v3/projects/82f810c4f73d49d787de3b44e389bf85 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:12.065684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273799-c6f4-4a36-8d83-0981b8b006d1 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.066183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273799-c6f4-4a36-8d83-0981b8b006d1 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.066317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273799-c6f4-4a36-8d83-0981b8b006d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.096032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-80273799-c6f4-4a36-8d83-0981b8b006d1 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:12.097382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-80273799-c6f4-4a36-8d83-0981b8b006d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:12.157190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1161/2304] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:12.166598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44762dde-260f-427a-91f4-a25052158bdc None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.166938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44762dde-260f-427a-91f4-a25052158bdc None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.167259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44762dde-260f-427a-91f4-a25052158bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.188066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-44762dde-260f-427a-91f4-a25052158bdc None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:12.189299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-44762dde-260f-427a-91f4-a25052158bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:12.197168 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1144/2305] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:19:12.201534 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80273799-c6f4-4a36-8d83-0981b8b006d1 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.211185 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80273799-c6f4-4a36-8d83-0981b8b006d1 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.215832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d90334-7a8c-4e67-8286-bee49ad4a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.216476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d90334-7a8c-4e67-8286-bee49ad4a40a admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.216758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d90334-7a8c-4e67-8286-bee49ad4a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.217043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d90334-7a8c-4e67-8286-bee49ad4a40a admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.217707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d90334-7a8c-4e67-8286-bee49ad4a40a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:19:12.218096 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d90334-7a8c-4e67-8286-bee49ad4a40a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.219619 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d90334-7a8c-4e67-8286-bee49ad4a40a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.232146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1162/2306] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:19:12.236835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44762dde-260f-427a-91f4-a25052158bdc None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.245881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44762dde-260f-427a-91f4-a25052158bdc None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.250489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594b5a-23d7-402d-902d-ca880e36c499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.251077 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594b5a-23d7-402d-902d-ca880e36c499 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.251350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594b5a-23d7-402d-902d-ca880e36c499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.251685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594b5a-23d7-402d-902d-ca880e36c499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.252394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77594b5a-23d7-402d-902d-ca880e36c499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.254252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77594b5a-23d7-402d-902d-ca880e36c499 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.283577 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1145/2307] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:12 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:19:12.287697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d90334-7a8c-4e67-8286-bee49ad4a40a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.297784 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d90334-7a8c-4e67-8286-bee49ad4a40a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.309128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:12.357211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ff95a-5a85-483c-8c8a-2667c730fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.357814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ff95a-5a85-483c-8c8a-2667c730fd4d admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.358094 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ff95a-5a85-483c-8c8a-2667c730fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.358364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ff95a-5a85-483c-8c8a-2667c730fd4d admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.358988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ff95a-5a85-483c-8c8a-2667c730fd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.361255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ff95a-5a85-483c-8c8a-2667c730fd4d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.383823 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1163/2308] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:12 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:12.388211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594b5a-23d7-402d-902d-ca880e36c499 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.398866 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594b5a-23d7-402d-902d-ca880e36c499 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.404084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ad1cb-85df-4898-b233-75f264378d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.404736 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ad1cb-85df-4898-b233-75f264378d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.405041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ad1cb-85df-4898-b233-75f264378d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.405299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ad1cb-85df-4898-b233-75f264378d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.405977 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ad1cb-85df-4898-b233-75f264378d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.407691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ad1cb-85df-4898-b233-75f264378d39 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.417741 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1146/2309] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:12.421849 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ff95a-5a85-483c-8c8a-2667c730fd4d admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.431953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ff95a-5a85-483c-8c8a-2667c730fd4d admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.437082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c305f6-f9f3-4ac8-9309-612d670d0bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.437673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c305f6-f9f3-4ac8-9309-612d670d0bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.437946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c305f6-f9f3-4ac8-9309-612d670d0bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.438209 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c305f6-f9f3-4ac8-9309-612d670d0bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.438876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c305f6-f9f3-4ac8-9309-612d670d0bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.440495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c305f6-f9f3-4ac8-9309-612d670d0bbd admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.451343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1164/2310] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:12.455620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ad1cb-85df-4898-b233-75f264378d39 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.466244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ad1cb-85df-4898-b233-75f264378d39 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.471537 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccdfe4-d418-483d-9cd6-d2db87efd89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.472240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccdfe4-d418-483d-9cd6-d2db87efd89b admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.472561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccdfe4-d418-483d-9cd6-d2db87efd89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.472833 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccdfe4-d418-483d-9cd6-d2db87efd89b admin admin] PATH_INFO: `/v3/projects/ffbadc2a73114b8781d5b87c03422e37/users/2ebf1e7e1afd40fbaf23290950701379/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.493568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccdfe4-d418-483d-9cd6-d2db87efd89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbadc2a73114b8781d5b87c03422e37, user_id=2ebf1e7e1afd40fbaf23290950701379, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.496258 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccdfe4-d418-483d-9cd6-d2db87efd89b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.510947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1147/2311] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:12 2022] PUT /identity/v3/projects/ffbadc2a73114b8781d5b87c03422e37/users/2ebf1e7e1afd40fbaf23290950701379/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:12.521588 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f645d0c-ef4c-4ca9-b15e-2be24715e1ae None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.521884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f645d0c-ef4c-4ca9-b15e-2be24715e1ae None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.522177 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f645d0c-ef4c-4ca9-b15e-2be24715e1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.550302 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9f645d0c-ef4c-4ca9-b15e-2be24715e1ae None None] MFA Rules not processed for user `2ebf1e7e1afd40fbaf23290950701379`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:12.551510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9f645d0c-ef4c-4ca9-b15e-2be24715e1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:12.619360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1165/2312] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:12.624254 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccdfe4-d418-483d-9cd6-d2db87efd89b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.688800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccdfe4-d418-483d-9cd6-d2db87efd89b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.694074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f66890-a1e0-42ca-b120-f92a44b0b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.694688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f66890-a1e0-42ca-b120-f92a44b0b3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.694969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f66890-a1e0-42ca-b120-f92a44b0b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.695239 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f66890-a1e0-42ca-b120-f92a44b0b3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.695860 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f66890-a1e0-42ca-b120-f92a44b0b3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.697844 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f66890-a1e0-42ca-b120-f92a44b0b3ab admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.726527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1148/2313] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:12 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:12.730188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f645d0c-ef4c-4ca9-b15e-2be24715e1ae None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.741345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f645d0c-ef4c-4ca9-b15e-2be24715e1ae None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.799042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b802-7b97-4196-ab9c-420e716c621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.799660 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b802-7b97-4196-ab9c-420e716c621d admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.799945 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b802-7b97-4196-ab9c-420e716c621d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.800224 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b802-7b97-4196-ab9c-420e716c621d admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.800889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961b802-7b97-4196-ab9c-420e716c621d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.803079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961b802-7b97-4196-ab9c-420e716c621d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.826282 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1166/2314] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:12 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:12.830471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f66890-a1e0-42ca-b120-f92a44b0b3ab admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.841562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f66890-a1e0-42ca-b120-f92a44b0b3ab admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.846775 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2946-d15f-4277-a048-33e60335740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.847384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2946-d15f-4277-a048-33e60335740d admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.847670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2946-d15f-4277-a048-33e60335740d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.847913 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2946-d15f-4277-a048-33e60335740d admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.848584 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2946-d15f-4277-a048-33e60335740d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.850186 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2946-d15f-4277-a048-33e60335740d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.862881 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1149/2315] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:12.867133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b802-7b97-4196-ab9c-420e716c621d admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.878195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b802-7b97-4196-ab9c-420e716c621d admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.883807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84822ad-d382-40d3-8963-1845358abcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.884498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84822ad-d382-40d3-8963-1845358abcf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.884780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84822ad-d382-40d3-8963-1845358abcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.885062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84822ad-d382-40d3-8963-1845358abcf0 admin admin] PATH_INFO: `/v3/projects/a0dbdd713bf749b5bf948e4c58770209/users/046c4c21a1c24fbe92fca11fd8fbbddd/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.896405 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:12.901203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84822ad-d382-40d3-8963-1845358abcf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dbdd713bf749b5bf948e4c58770209, user_id=046c4c21a1c24fbe92fca11fd8fbbddd, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.904237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84822ad-d382-40d3-8963-1845358abcf0 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:12.918992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1167/2316] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:12 2022] PUT /identity/v3/projects/a0dbdd713bf749b5bf948e4c58770209/users/046c4c21a1c24fbe92fca11fd8fbbddd/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:12.923047 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2946-d15f-4277-a048-33e60335740d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:12.933085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2946-d15f-4277-a048-33e60335740d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:12.950146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:12.991548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719035d9-dfb5-48ca-bb5a-5c263a89100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:12.992146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719035d9-dfb5-48ca-bb5a-5c263a89100a admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:12.992457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719035d9-dfb5-48ca-bb5a-5c263a89100a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:12.992724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719035d9-dfb5-48ca-bb5a-5c263a89100a admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:12.993355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719035d9-dfb5-48ca-bb5a-5c263a89100a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:12.994950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719035d9-dfb5-48ca-bb5a-5c263a89100a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:13.006623 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1150/2317] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:13.011172 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84822ad-d382-40d3-8963-1845358abcf0 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:13.022967 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84822ad-d382-40d3-8963-1845358abcf0 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:13.028318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f81ef3-e2ba-4fc4-a7d8-a843f394293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:13.029042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f81ef3-e2ba-4fc4-a7d8-a843f394293a admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:13.029352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f81ef3-e2ba-4fc4-a7d8-a843f394293a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:13.029625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f81ef3-e2ba-4fc4-a7d8-a843f394293a admin admin] PATH_INFO: `/v3/projects/a0dbdd713bf749b5bf948e4c58770209/users/046c4c21a1c24fbe92fca11fd8fbbddd/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:13.031817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f81ef3-e2ba-4fc4-a7d8-a843f394293a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dbdd713bf749b5bf948e4c58770209, user_id=046c4c21a1c24fbe92fca11fd8fbbddd, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:13.034541 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f81ef3-e2ba-4fc4-a7d8-a843f394293a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:13.046267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1168/2318] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:13 2022] PUT /identity/v3/projects/a0dbdd713bf749b5bf948e4c58770209/users/046c4c21a1c24fbe92fca11fd8fbbddd/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:13.057515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7d3c6-f7dc-4672-b079-f56f3fab43ae None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:13.057515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7d3c6-f7dc-4672-b079-f56f3fab43ae None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:13.057679 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7d3c6-f7dc-4672-b079-f56f3fab43ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:13.086223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-bca7d3c6-f7dc-4672-b079-f56f3fab43ae None None] MFA Rules not processed for user `046c4c21a1c24fbe92fca11fd8fbbddd`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:13.087441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bca7d3c6-f7dc-4672-b079-f56f3fab43ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:13.157477 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1151/2319] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:13.169427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f81ef3-e2ba-4fc4-a7d8-a843f394293a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:13.171531 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b5f81ef3-e2ba-4fc4-a7d8-a843f394293a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:13.233994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f81ef3-e2ba-4fc4-a7d8-a843f394293a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:13.238152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef9524-90c7-4838-9f15-10f2b3457eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:13.238764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9524-90c7-4838-9f15-10f2b3457eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:13.239048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9524-90c7-4838-9f15-10f2b3457eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:13.239322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9524-90c7-4838-9f15-10f2b3457eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:13.248404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef9524-90c7-4838-9f15-10f2b3457eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:13.249871 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef9524-90c7-4838-9f15-10f2b3457eb6 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:13.259383 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1169/2320] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:13.342773 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7d3c6-f7dc-4672-b079-f56f3fab43ae None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:13.353136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7d3c6-f7dc-4672-b079-f56f3fab43ae None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:13.357603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6bf39-2af9-4c06-b182-e9e3b4e77c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:13.358212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6bf39-2af9-4c06-b182-e9e3b4e77c2f service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:13.358485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6bf39-2af9-4c06-b182-e9e3b4e77c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:13.358747 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6bf39-2af9-4c06-b182-e9e3b4e77c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:13.418755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6bf39-2af9-4c06-b182-e9e3b4e77c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:13.420191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6bf39-2af9-4c06-b182-e9e3b4e77c2f service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:13.429732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1152/2321] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:20.321591 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef9524-90c7-4838-9f15-10f2b3457eb6 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:20.385792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef9524-90c7-4838-9f15-10f2b3457eb6 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:20.398413 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:20.399231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:20.399512 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:20.399783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] PATH_INFO: `/v3/users/2ebf1e7e1afd40fbaf23290950701379` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:20.401251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ebf1e7e1afd40fbaf23290950701379)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:20.403261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:20.465839 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ebf1e7e1afd40fbaf23290950701379'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:20.473459 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ebf1e7e1afd40fbaf23290950701379'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:20.474136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ebf1e7e1afd40fbaf23290950701379'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:20.489277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ebf1e7e1afd40fbaf23290950701379'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:20.490110 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ebf1e7e1afd40fbaf23290950701379'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:20.500124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:20.506377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1170/2322] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:20 2022] DELETE /identity/v3/users/2ebf1e7e1afd40fbaf23290950701379 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:20.511286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40beae-3e88-46de-9054-8684a5d445db None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:20.511838 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40beae-3e88-46de-9054-8684a5d445db None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:20.511949 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40beae-3e88-46de-9054-8684a5d445db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:20.532908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ea40beae-3e88-46de-9054-8684a5d445db None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:20.536030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ea40beae-3e88-46de-9054-8684a5d445db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:20.571810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:20.598606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1153/2323] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:20.608707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:20.610678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:20.675888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c49ef-0a76-416d-bf50-f2d72c6f8f83 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:20.680164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1dabd-f85e-4457-a2ea-fc516268c533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:20.680812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1dabd-f85e-4457-a2ea-fc516268c533 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:20.681098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1dabd-f85e-4457-a2ea-fc516268c533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:20.681373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1dabd-f85e-4457-a2ea-fc516268c533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:20.694661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1dabd-f85e-4457-a2ea-fc516268c533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:20.696121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1dabd-f85e-4457-a2ea-fc516268c533 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:20.706336 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1171/2324] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:20.991059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40beae-3e88-46de-9054-8684a5d445db None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:20.992703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ea40beae-3e88-46de-9054-8684a5d445db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:21.007701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40beae-3e88-46de-9054-8684a5d445db None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:21.014247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:21.015011 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:21.015249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:21.015503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] PATH_INFO: `/v3/projects/ffbadc2a73114b8781d5b87c03422e37` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:21.016923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbadc2a73114b8781d5b87c03422e37)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:21.018547 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:21.069763 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbadc2a73114b8781d5b87c03422e37', 'request_id': 'req-9e0c6c3d-235f-4878-b920-1c95b942ec3a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.079455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbadc2a73114b8781d5b87c03422e37', 'request_id': 'req-9e0c6c3d-235f-4878-b920-1c95b942ec3a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.087134 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbadc2a73114b8781d5b87c03422e37', 'request_id': 'req-9e0c6c3d-235f-4878-b920-1c95b942ec3a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.098250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] The token cache is being invalidate because project ffbadc2a73114b8781d5b87c03422e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:21.098475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.099154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.100912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1154/2325] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:20 2022] DELETE /identity/v3/projects/ffbadc2a73114b8781d5b87c03422e37 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:21.105039 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1dabd-f85e-4457-a2ea-fc516268c533 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:21.115773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1dabd-f85e-4457-a2ea-fc516268c533 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:21.174056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:21.174757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:21.174992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:21.175333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] PATH_INFO: `/v3/users/046c4c21a1c24fbe92fca11fd8fbbddd` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:21.176635 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=046c4c21a1c24fbe92fca11fd8fbbddd)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:21.182993 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:21.228870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046c4c21a1c24fbe92fca11fd8fbbddd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.236359 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046c4c21a1c24fbe92fca11fd8fbbddd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.237105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046c4c21a1c24fbe92fca11fd8fbbddd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.255153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046c4c21a1c24fbe92fca11fd8fbbddd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.255933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8b275c80-5197-40ae-8286-7be095e41d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046c4c21a1c24fbe92fca11fd8fbbddd'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.271007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1172/2326] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:21 2022] DELETE /identity/v3/users/046c4c21a1c24fbe92fca11fd8fbbddd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:21.554555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:21.556022 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:21.570465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c6c3d-235f-4878-b920-1c95b942ec3a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:21.637404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:21.637995 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:21.638275 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:21.638575 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] PATH_INFO: `/v3/projects/a0dbdd713bf749b5bf948e4c58770209` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:21.639733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0dbdd713bf749b5bf948e4c58770209)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:21.641697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:21.693740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0dbdd713bf749b5bf948e4c58770209', 'request_id': 'req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.703876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0dbdd713bf749b5bf948e4c58770209', 'request_id': 'req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.711379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0dbdd713bf749b5bf948e4c58770209', 'request_id': 'req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.715789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:21.724166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] The token cache is being invalidate because project a0dbdd713bf749b5bf948e4c58770209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:21.724518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.725301 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-1b9e6468-3f61-4af5-a50e-4dda8564c1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:21.726950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1155/2327] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:21 2022] DELETE /identity/v3/projects/a0dbdd713bf749b5bf948e4c58770209 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:21.732028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75f57-e072-43cd-bf82-422dc55dc940 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:21.732564 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75f57-e072-43cd-bf82-422dc55dc940 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:21.732655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b75f57-e072-43cd-bf82-422dc55dc940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:21.754228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c1b75f57-e072-43cd-bf82-422dc55dc940 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:21.755491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c1b75f57-e072-43cd-bf82-422dc55dc940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:21.769398 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:21.821427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1173/2328] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:21.829667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ab73a-d525-4eb4-b55d-7afdc1ef614c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:21.829955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ab73a-d525-4eb4-b55d-7afdc1ef614c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:21.830227 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ab73a-d525-4eb4-b55d-7afdc1ef614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:21.850682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2e0ab73a-d525-4eb4-b55d-7afdc1ef614c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:21.851946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2e0ab73a-d525-4eb4-b55d-7afdc1ef614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:21.861592 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1156/2329] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:21.866411 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b75f57-e072-43cd-bf82-422dc55dc940 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:21.876916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b75f57-e072-43cd-bf82-422dc55dc940 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:21.882495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d1e67-cce3-4377-8aeb-d31a06b247ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:21.883110 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d1e67-cce3-4377-8aeb-d31a06b247ba admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:21.883391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d1e67-cce3-4377-8aeb-d31a06b247ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:21.883666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d1e67-cce3-4377-8aeb-d31a06b247ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:21.884323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d1e67-cce3-4377-8aeb-d31a06b247ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:19:21.884661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d1e67-cce3-4377-8aeb-d31a06b247ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:21.886275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d1e67-cce3-4377-8aeb-d31a06b247ba admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:21.898446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1174/2330] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:19:21.903065 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ab73a-d525-4eb4-b55d-7afdc1ef614c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:21.913081 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ab73a-d525-4eb4-b55d-7afdc1ef614c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:21.919437 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34584740-9b53-4672-a528-7d4c11ff2b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:21.920079 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584740-9b53-4672-a528-7d4c11ff2b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:21.920384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584740-9b53-4672-a528-7d4c11ff2b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:21.920652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584740-9b53-4672-a528-7d4c11ff2b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:21.921281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34584740-9b53-4672-a528-7d4c11ff2b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:21.923225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34584740-9b53-4672-a528-7d4c11ff2b9a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:21.955991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1157/2331] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:21 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:21.960427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d1e67-cce3-4377-8aeb-d31a06b247ba admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:21.970618 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d1e67-cce3-4377-8aeb-d31a06b247ba admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.037236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c168c37-2a25-4bd7-b6a3-ab2d8ef6654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.037879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c168c37-2a25-4bd7-b6a3-ab2d8ef6654e admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.038160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c168c37-2a25-4bd7-b6a3-ab2d8ef6654e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.038435 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c168c37-2a25-4bd7-b6a3-ab2d8ef6654e admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.039068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c168c37-2a25-4bd7-b6a3-ab2d8ef6654e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.041061 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c168c37-2a25-4bd7-b6a3-ab2d8ef6654e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:22.064518 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1175/2332] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:21 2022] POST /identity/v3/users => generated 278 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:22.068852 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34584740-9b53-4672-a528-7d4c11ff2b9a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:22.079497 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34584740-9b53-4672-a528-7d4c11ff2b9a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.084438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4270db-3d6c-4851-bebb-390cd0e30d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.085041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4270db-3d6c-4851-bebb-390cd0e30d1c admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.085321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4270db-3d6c-4851-bebb-390cd0e30d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.085596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4270db-3d6c-4851-bebb-390cd0e30d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.086252 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4270db-3d6c-4851-bebb-390cd0e30d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.087869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4270db-3d6c-4851-bebb-390cd0e30d1c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:22.101485 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1158/2333] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:22.105817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c168c37-2a25-4bd7-b6a3-ab2d8ef6654e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:22.116683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c168c37-2a25-4bd7-b6a3-ab2d8ef6654e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.121976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b2ed4-8712-49a3-9b90-baa673742cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.122790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b2ed4-8712-49a3-9b90-baa673742cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.123112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b2ed4-8712-49a3-9b90-baa673742cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.123401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b2ed4-8712-49a3-9b90-baa673742cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.124054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b2ed4-8712-49a3-9b90-baa673742cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.125756 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b2ed4-8712-49a3-9b90-baa673742cb4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:22.140710 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1176/2334] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:22.141904 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4270db-3d6c-4851-bebb-390cd0e30d1c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:22.154582 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4270db-3d6c-4851-bebb-390cd0e30d1c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.160816 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d0c00-ffb7-4475-ba03-66c560c7ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.161107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d0c00-ffb7-4475-ba03-66c560c7ca93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.161682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d0c00-ffb7-4475-ba03-66c560c7ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.161932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d0c00-ffb7-4475-ba03-66c560c7ca93 admin admin] PATH_INFO: `/v3/projects/8c4f39fa74d94ce483adc89b02be390a/users/de62b331011a4b9ba542e4dd02bfca6b/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.183732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d0c00-ffb7-4475-ba03-66c560c7ca93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4f39fa74d94ce483adc89b02be390a, user_id=de62b331011a4b9ba542e4dd02bfca6b, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.186449 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d0c00-ffb7-4475-ba03-66c560c7ca93 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:22.202685 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1159/2335] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:22 2022] PUT /identity/v3/projects/8c4f39fa74d94ce483adc89b02be390a/users/de62b331011a4b9ba542e4dd02bfca6b/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:22.213758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f2bd3-0b43-46bd-a1ee-29705032d9ac None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.214071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f2bd3-0b43-46bd-a1ee-29705032d9ac None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.214347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f2bd3-0b43-46bd-a1ee-29705032d9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.245330 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-e78f2bd3-0b43-46bd-a1ee-29705032d9ac None None] MFA Rules not processed for user `de62b331011a4b9ba542e4dd02bfca6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:22.246543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e78f2bd3-0b43-46bd-a1ee-29705032d9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:22.321745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1177/2336] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:22.326781 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d0c00-ffb7-4475-ba03-66c560c7ca93 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:22.393959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d0c00-ffb7-4475-ba03-66c560c7ca93 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.399407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff7653-27ec-4260-a5c7-e9229c5082ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.400018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff7653-27ec-4260-a5c7-e9229c5082ec admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.400319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff7653-27ec-4260-a5c7-e9229c5082ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.400620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff7653-27ec-4260-a5c7-e9229c5082ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.401240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff7653-27ec-4260-a5c7-e9229c5082ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.403303 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff7653-27ec-4260-a5c7-e9229c5082ec admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:22.440102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1160/2337] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:22 2022] POST /identity/v3/projects => generated 357 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:22.444244 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f2bd3-0b43-46bd-a1ee-29705032d9ac None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:22.455669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f2bd3-0b43-46bd-a1ee-29705032d9ac None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.467887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:22.515922 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ba71-7f5c-49b8-99af-378a93098a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.516569 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ba71-7f5c-49b8-99af-378a93098a62 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.516855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ba71-7f5c-49b8-99af-378a93098a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.517128 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ba71-7f5c-49b8-99af-378a93098a62 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.517774 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7ba71-7f5c-49b8-99af-378a93098a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.519934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7ba71-7f5c-49b8-99af-378a93098a62 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:22.542087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1178/2338] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:22 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:22.546468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff7653-27ec-4260-a5c7-e9229c5082ec admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:22.557605 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff7653-27ec-4260-a5c7-e9229c5082ec admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.563807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622b65-d761-444d-8470-de757501c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.564489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622b65-d761-444d-8470-de757501c205 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.564772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622b65-d761-444d-8470-de757501c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.565045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622b65-d761-444d-8470-de757501c205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.565711 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8622b65-d761-444d-8470-de757501c205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.567355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8622b65-d761-444d-8470-de757501c205 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:22.579050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1161/2339] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:22.583475 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ba71-7f5c-49b8-99af-378a93098a62 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:22.594183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ba71-7f5c-49b8-99af-378a93098a62 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.599434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad346c44-7987-4f80-a2d5-5f4802980039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.600130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad346c44-7987-4f80-a2d5-5f4802980039 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.600454 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad346c44-7987-4f80-a2d5-5f4802980039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.600730 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad346c44-7987-4f80-a2d5-5f4802980039 admin admin] PATH_INFO: `/v3/projects/87f56df40fce4834bd0a04c78ea2efa9/users/d79c5d6a40a14e88a46054ce1293d876/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.618697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad346c44-7987-4f80-a2d5-5f4802980039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f56df40fce4834bd0a04c78ea2efa9, user_id=d79c5d6a40a14e88a46054ce1293d876, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.621719 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad346c44-7987-4f80-a2d5-5f4802980039 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:22.638360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1179/2340] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:22 2022] PUT /identity/v3/projects/87f56df40fce4834bd0a04c78ea2efa9/users/d79c5d6a40a14e88a46054ce1293d876/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:22.642626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622b65-d761-444d-8470-de757501c205 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:22.652897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622b65-d761-444d-8470-de757501c205 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.714628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324ff03-8f70-442d-9661-f1c96a452a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.715226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324ff03-8f70-442d-9661-f1c96a452a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.715473 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324ff03-8f70-442d-9661-f1c96a452a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.715745 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324ff03-8f70-442d-9661-f1c96a452a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.716493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324ff03-8f70-442d-9661-f1c96a452a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.718229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324ff03-8f70-442d-9661-f1c96a452a01 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:22.725479 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:22.733149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1162/2341] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:19:22.738894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad346c44-7987-4f80-a2d5-5f4802980039 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:22.748693 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad346c44-7987-4f80-a2d5-5f4802980039 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.753119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec3d97-db7f-441d-9f48-8eda9abef5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.753768 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec3d97-db7f-441d-9f48-8eda9abef5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.754039 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec3d97-db7f-441d-9f48-8eda9abef5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.754310 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec3d97-db7f-441d-9f48-8eda9abef5d5 admin admin] PATH_INFO: `/v3/projects/87f56df40fce4834bd0a04c78ea2efa9/users/d79c5d6a40a14e88a46054ce1293d876/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.756170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec3d97-db7f-441d-9f48-8eda9abef5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f56df40fce4834bd0a04c78ea2efa9, user_id=d79c5d6a40a14e88a46054ce1293d876, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.758813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec3d97-db7f-441d-9f48-8eda9abef5d5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:22.770047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1180/2342] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:22 2022] PUT /identity/v3/projects/87f56df40fce4834bd0a04c78ea2efa9/users/d79c5d6a40a14e88a46054ce1293d876/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:22.784005 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec26e-e7ec-40f5-8303-96190e53bfc0 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.784269 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec26e-e7ec-40f5-8303-96190e53bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.784692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec26e-e7ec-40f5-8303-96190e53bfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.817804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2ceec26e-e7ec-40f5-8303-96190e53bfc0 None None] MFA Rules not processed for user `d79c5d6a40a14e88a46054ce1293d876`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:22.819000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2ceec26e-e7ec-40f5-8303-96190e53bfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:22.896765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1163/2343] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:22.908000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec3d97-db7f-441d-9f48-8eda9abef5d5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:22.909948 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-07ec3d97-db7f-441d-9f48-8eda9abef5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:22.972169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec3d97-db7f-441d-9f48-8eda9abef5d5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:22.976517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac61ed8-47a7-49f5-b2f2-dacbb47d6773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:22.977158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac61ed8-47a7-49f5-b2f2-dacbb47d6773 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:22.977437 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac61ed8-47a7-49f5-b2f2-dacbb47d6773 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:22.977708 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac61ed8-47a7-49f5-b2f2-dacbb47d6773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:22.987522 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac61ed8-47a7-49f5-b2f2-dacbb47d6773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:22.989008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac61ed8-47a7-49f5-b2f2-dacbb47d6773 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:23.000137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1181/2344] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:23.080063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec26e-e7ec-40f5-8303-96190e53bfc0 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:23.090443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec26e-e7ec-40f5-8303-96190e53bfc0 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:23.094248 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ddd1c-fe0a-4372-ac01-052984af033c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:23.094848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ddd1c-fe0a-4372-ac01-052984af033c service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:23.095124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ddd1c-fe0a-4372-ac01-052984af033c service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:23.095392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ddd1c-fe0a-4372-ac01-052984af033c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:23.154753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ddd1c-fe0a-4372-ac01-052984af033c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:23.156383 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ddd1c-fe0a-4372-ac01-052984af033c service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:23.167455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1164/2345] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:32.994521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:33.162196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=62 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:34.684235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac61ed8-47a7-49f5-b2f2-dacbb47d6773 service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:34.686051 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-aac61ed8-47a7-49f5-b2f2-dacbb47d6773 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:34.753691 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac61ed8-47a7-49f5-b2f2-dacbb47d6773 service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:34.758378 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:34.759051 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:34.759296 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:34.759561 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] PATH_INFO: `/v3/users/bd0427fedb3c4241a6e4fd216d1ebd36` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:34.760697 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0427fedb3c4241a6e4fd216d1ebd36)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:34.762639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:34.814103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0427fedb3c4241a6e4fd216d1ebd36'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:34.821323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0427fedb3c4241a6e4fd216d1ebd36'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:34.822007 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0427fedb3c4241a6e4fd216d1ebd36'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:34.834679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0427fedb3c4241a6e4fd216d1ebd36'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:34.835311 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0427fedb3c4241a6e4fd216d1ebd36'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:34.851019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1182/2346] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:34 2022] DELETE /identity/v3/users/bd0427fedb3c4241a6e4fd216d1ebd36 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:34.855623 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec66f26-bb7a-4b0d-a058-bb0504c10433 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:34.856075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec66f26-bb7a-4b0d-a058-bb0504c10433 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:34.856271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec66f26-bb7a-4b0d-a058-bb0504c10433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:34.879984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7ec66f26-bb7a-4b0d-a058-bb0504c10433 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:34.887192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7ec66f26-bb7a-4b0d-a058-bb0504c10433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:34.960737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1165/2347] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:19:34.971369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:34.973126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:35.034798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28246f87-6f57-476f-a600-6e6c79884849 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:35.038851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d6aff-eaed-40df-9fef-7f618dd55623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:35.039489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d6aff-eaed-40df-9fef-7f618dd55623 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:35.039780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d6aff-eaed-40df-9fef-7f618dd55623 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:35.040056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d6aff-eaed-40df-9fef-7f618dd55623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:35.050121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d6aff-eaed-40df-9fef-7f618dd55623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:35.051525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d6aff-eaed-40df-9fef-7f618dd55623 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:35.061194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1183/2348] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:35.338029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec66f26-bb7a-4b0d-a058-bb0504c10433 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:35.339730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7ec66f26-bb7a-4b0d-a058-bb0504c10433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:35.354106 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec66f26-bb7a-4b0d-a058-bb0504c10433 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:35.359755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:35.360551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:35.360903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:35.361237 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] PATH_INFO: `/v3/projects/1e9f37b1681d4a47b663293773bddc26` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:35.362525 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9f37b1681d4a47b663293773bddc26)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:35.364800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:35.415841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9f37b1681d4a47b663293773bddc26', 'request_id': 'req-528fbeb5-daff-4755-8c66-cf1e509a46fe'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:35.425358 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9f37b1681d4a47b663293773bddc26', 'request_id': 'req-528fbeb5-daff-4755-8c66-cf1e509a46fe'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:35.435960 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9f37b1681d4a47b663293773bddc26', 'request_id': 'req-528fbeb5-daff-4755-8c66-cf1e509a46fe'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:35.449799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] The token cache is being invalidate because project 1e9f37b1681d4a47b663293773bddc26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:35.450245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:35.450926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-528fbeb5-daff-4755-8c66-cf1e509a46fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:35.452641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1166/2349] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:35 2022] DELETE /identity/v3/projects/1e9f37b1681d4a47b663293773bddc26 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:38.294924 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d6aff-eaed-40df-9fef-7f618dd55623 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:38.296628 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d82d6aff-eaed-40df-9fef-7f618dd55623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:38.310249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d6aff-eaed-40df-9fef-7f618dd55623 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:38.329944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:38.372677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:38.373318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:38.373596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:38.373867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] PATH_INFO: `/v3/users/de62b331011a4b9ba542e4dd02bfca6b` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:38.375156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de62b331011a4b9ba542e4dd02bfca6b)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:38.377126 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:38.423913 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de62b331011a4b9ba542e4dd02bfca6b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:38.430747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de62b331011a4b9ba542e4dd02bfca6b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:38.431407 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de62b331011a4b9ba542e4dd02bfca6b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:38.443152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de62b331011a4b9ba542e4dd02bfca6b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:38.443796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de62b331011a4b9ba542e4dd02bfca6b'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:38.458205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1184/2350] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:38 2022] DELETE /identity/v3/users/de62b331011a4b9ba542e4dd02bfca6b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:38.462846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b000b7-ea79-41f5-ab6a-834edd70046f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:38.463328 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b000b7-ea79-41f5-ab6a-834edd70046f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:38.463454 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b000b7-ea79-41f5-ab6a-834edd70046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:38.482854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-05b000b7-ea79-41f5-ab6a-834edd70046f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:38.484392 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-05b000b7-ea79-41f5-ab6a-834edd70046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:38.546643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1167/2351] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:38.557093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:38.558683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:38.621701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5939-139a-4bf8-b0a6-1415fc5d09e5 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:38.625508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052daad8-c3c2-4819-ae86-98eec55dd23f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:38.626055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052daad8-c3c2-4819-ae86-98eec55dd23f service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:38.626331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052daad8-c3c2-4819-ae86-98eec55dd23f service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:38.626595 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052daad8-c3c2-4819-ae86-98eec55dd23f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:38.635552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052daad8-c3c2-4819-ae86-98eec55dd23f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:38.637019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052daad8-c3c2-4819-ae86-98eec55dd23f service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:38.646254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1185/2352] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:38.916809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b000b7-ea79-41f5-ab6a-834edd70046f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:38.919211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-05b000b7-ea79-41f5-ab6a-834edd70046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:38.935800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b000b7-ea79-41f5-ab6a-834edd70046f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:38.942378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:38.943017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:38.943290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:38.943593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] PATH_INFO: `/v3/projects/8c4f39fa74d94ce483adc89b02be390a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:38.944683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4f39fa74d94ce483adc89b02be390a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:38.946786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:38.970979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:38.998784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4f39fa74d94ce483adc89b02be390a', 'request_id': 'req-008905b8-b790-465e-a54f-bf8b1a6e1282'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.007201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4f39fa74d94ce483adc89b02be390a', 'request_id': 'req-008905b8-b790-465e-a54f-bf8b1a6e1282'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.013538 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4f39fa74d94ce483adc89b02be390a', 'request_id': 'req-008905b8-b790-465e-a54f-bf8b1a6e1282'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.024074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] The token cache is being invalidate because project 8c4f39fa74d94ce483adc89b02be390a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:39.024385 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.025074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.026658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1168/2353] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:38 2022] DELETE /identity/v3/projects/8c4f39fa74d94ce483adc89b02be390a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:39.030799 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052daad8-c3c2-4819-ae86-98eec55dd23f service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:39.040808 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052daad8-c3c2-4819-ae86-98eec55dd23f service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:39.084192 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:39.101560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:39.102212 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:39.102488 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:39.102759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] PATH_INFO: `/v3/users/d79c5d6a40a14e88a46054ce1293d876` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:39.103898 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79c5d6a40a14e88a46054ce1293d876)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:39.105888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:39.155859 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79c5d6a40a14e88a46054ce1293d876'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.162749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79c5d6a40a14e88a46054ce1293d876'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.163375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79c5d6a40a14e88a46054ce1293d876'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.174978 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79c5d6a40a14e88a46054ce1293d876'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.175650 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-6d1b231f-c2e2-4848-97e1-1e753534d3b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79c5d6a40a14e88a46054ce1293d876'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.191301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1186/2354] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:39 2022] DELETE /identity/v3/users/d79c5d6a40a14e88a46054ce1293d876 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:39.462008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:39.463515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:39.477927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008905b8-b790-465e-a54f-bf8b1a6e1282 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:39.536753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:39.537417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:39.537696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:39.537950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] PATH_INFO: `/v3/projects/87f56df40fce4834bd0a04c78ea2efa9` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:39.539280 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f56df40fce4834bd0a04c78ea2efa9)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:39.541559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:39.590581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f56df40fce4834bd0a04c78ea2efa9', 'request_id': 'req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.599302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f56df40fce4834bd0a04c78ea2efa9', 'request_id': 'req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.606036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f56df40fce4834bd0a04c78ea2efa9', 'request_id': 'req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.617324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] The token cache is being invalidate because project 87f56df40fce4834bd0a04c78ea2efa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:39.617613 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.618264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-6d9a3951-ca31-47cd-9b28-f1908fcedd3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:39.619757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1169/2355] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:39 2022] DELETE /identity/v3/projects/87f56df40fce4834bd0a04c78ea2efa9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:39.625239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596c8fa-5386-426f-8f7a-8f69406f2e49 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:39.625710 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596c8fa-5386-426f-8f7a-8f69406f2e49 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:39.625820 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596c8fa-5386-426f-8f7a-8f69406f2e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:39.646159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-3596c8fa-5386-426f-8f7a-8f69406f2e49 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:39.647377 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3596c8fa-5386-426f-8f7a-8f69406f2e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:39.710044 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1187/2356] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:39.718964 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77832d58-a76f-41e1-8cfb-c348fe833703 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:39.719342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77832d58-a76f-41e1-8cfb-c348fe833703 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:39.719735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77832d58-a76f-41e1-8cfb-c348fe833703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:39.741050 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-77832d58-a76f-41e1-8cfb-c348fe833703 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:39.742260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-77832d58-a76f-41e1-8cfb-c348fe833703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:39.751804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1170/2357] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:39.756240 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596c8fa-5386-426f-8f7a-8f69406f2e49 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:39.767619 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596c8fa-5386-426f-8f7a-8f69406f2e49 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:39.773173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e99ac1-454e-49e1-8d88-1b7ca7d577e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:39.773792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e99ac1-454e-49e1-8d88-1b7ca7d577e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:39.774066 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e99ac1-454e-49e1-8d88-1b7ca7d577e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:39.774339 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e99ac1-454e-49e1-8d88-1b7ca7d577e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:39.775001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e99ac1-454e-49e1-8d88-1b7ca7d577e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:19:39.775317 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e99ac1-454e-49e1-8d88-1b7ca7d577e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:39.776972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e99ac1-454e-49e1-8d88-1b7ca7d577e1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:39.789718 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1188/2358] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:19:39.793945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77832d58-a76f-41e1-8cfb-c348fe833703 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:39.803887 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77832d58-a76f-41e1-8cfb-c348fe833703 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:39.808626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48876a42-f178-49e9-8748-9ad77d834d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:39.809222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876a42-f178-49e9-8748-9ad77d834d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:39.809500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876a42-f178-49e9-8748-9ad77d834d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:39.809767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876a42-f178-49e9-8748-9ad77d834d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:39.810398 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48876a42-f178-49e9-8748-9ad77d834d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:39.812343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48876a42-f178-49e9-8748-9ad77d834d10 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:39.849187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1171/2359] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:39 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:39.855468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e99ac1-454e-49e1-8d88-1b7ca7d577e1 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:39.866447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e99ac1-454e-49e1-8d88-1b7ca7d577e1 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:39.913401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:39.923759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc946b-3ba1-4ac6-9cc2-ecf000e268a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:39.924551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc946b-3ba1-4ac6-9cc2-ecf000e268a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:39.925002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc946b-3ba1-4ac6-9cc2-ecf000e268a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:39.925440 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc946b-3ba1-4ac6-9cc2-ecf000e268a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:39.926069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc946b-3ba1-4ac6-9cc2-ecf000e268a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:39.928042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc946b-3ba1-4ac6-9cc2-ecf000e268a4 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:39.952006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1189/2360] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:39 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:39.956483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48876a42-f178-49e9-8748-9ad77d834d10 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:39.967068 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48876a42-f178-49e9-8748-9ad77d834d10 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:39.972133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84252217-2d19-4101-973e-c6d7947b7aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:39.972870 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252217-2d19-4101-973e-c6d7947b7aff admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:39.973143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252217-2d19-4101-973e-c6d7947b7aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:39.973433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252217-2d19-4101-973e-c6d7947b7aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:39.974118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84252217-2d19-4101-973e-c6d7947b7aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:39.975732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84252217-2d19-4101-973e-c6d7947b7aff admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:39.978279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:39.988579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1172/2361] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:39.991762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc946b-3ba1-4ac6-9cc2-ecf000e268a4 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.001872 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc946b-3ba1-4ac6-9cc2-ecf000e268a4 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.006818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaee0a9-c034-4950-99c2-d1949f1f1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.007428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaee0a9-c034-4950-99c2-d1949f1f1c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.007724 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaee0a9-c034-4950-99c2-d1949f1f1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.007995 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaee0a9-c034-4950-99c2-d1949f1f1c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.008721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaee0a9-c034-4950-99c2-d1949f1f1c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.010426 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaee0a9-c034-4950-99c2-d1949f1f1c26 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:40.023247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1190/2362] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:40.026104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84252217-2d19-4101-973e-c6d7947b7aff admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.036177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84252217-2d19-4101-973e-c6d7947b7aff admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.041003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28579759-e2b9-4145-9841-097ea996d42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.041648 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579759-e2b9-4145-9841-097ea996d42f admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.041925 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579759-e2b9-4145-9841-097ea996d42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.042197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579759-e2b9-4145-9841-097ea996d42f admin admin] PATH_INFO: `/v3/projects/d9918b0b0748483f9284a7c956737051/users/109c7ad653294988bafc0d8dee5ab6a1/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.056524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28579759-e2b9-4145-9841-097ea996d42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9918b0b0748483f9284a7c956737051, user_id=109c7ad653294988bafc0d8dee5ab6a1, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.059208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28579759-e2b9-4145-9841-097ea996d42f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:40.072885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1173/2363] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:40 2022] PUT /identity/v3/projects/d9918b0b0748483f9284a7c956737051/users/109c7ad653294988bafc0d8dee5ab6a1/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:40.084673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66832fa-f26b-4bf7-9b58-8adf242b2acd None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.084960 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66832fa-f26b-4bf7-9b58-8adf242b2acd None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.085228 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66832fa-f26b-4bf7-9b58-8adf242b2acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.114324 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-e66832fa-f26b-4bf7-9b58-8adf242b2acd None None] MFA Rules not processed for user `109c7ad653294988bafc0d8dee5ab6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:40.115523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e66832fa-f26b-4bf7-9b58-8adf242b2acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:40.178281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1191/2364] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:40.183042 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28579759-e2b9-4145-9841-097ea996d42f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.251394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28579759-e2b9-4145-9841-097ea996d42f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.256460 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f80eb-b1de-42cf-858a-5a66294acbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.257113 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f80eb-b1de-42cf-858a-5a66294acbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.257378 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f80eb-b1de-42cf-858a-5a66294acbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.257646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f80eb-b1de-42cf-858a-5a66294acbd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.258268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f80eb-b1de-42cf-858a-5a66294acbd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.260187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f80eb-b1de-42cf-858a-5a66294acbd4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:40.287699 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1174/2365] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:40 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:40.291876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66832fa-f26b-4bf7-9b58-8adf242b2acd None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.303103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66832fa-f26b-4bf7-9b58-8adf242b2acd None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.361356 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392e8d-66ce-40a1-a555-dd086008f0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.361990 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392e8d-66ce-40a1-a555-dd086008f0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.362284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392e8d-66ce-40a1-a555-dd086008f0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.362581 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392e8d-66ce-40a1-a555-dd086008f0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.363235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44392e8d-66ce-40a1-a555-dd086008f0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.365210 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44392e8d-66ce-40a1-a555-dd086008f0f1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:40.391016 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1192/2366] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:40 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:19:40.393414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f80eb-b1de-42cf-858a-5a66294acbd4 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.404044 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f80eb-b1de-42cf-858a-5a66294acbd4 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.408973 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d30af-1096-456e-9868-af9533d66fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.409583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d30af-1096-456e-9868-af9533d66fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.409861 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d30af-1096-456e-9868-af9533d66fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.410166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d30af-1096-456e-9868-af9533d66fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.410814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d30af-1096-456e-9868-af9533d66fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.412465 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d30af-1096-456e-9868-af9533d66fd0 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:40.423267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1175/2367] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:40.427367 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392e8d-66ce-40a1-a555-dd086008f0f1 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.437769 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392e8d-66ce-40a1-a555-dd086008f0f1 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.443220 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159c145-fe86-4cab-b481-d939dbcef045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.443833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159c145-fe86-4cab-b481-d939dbcef045 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.444111 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159c145-fe86-4cab-b481-d939dbcef045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.444408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159c145-fe86-4cab-b481-d939dbcef045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.445074 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159c145-fe86-4cab-b481-d939dbcef045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.446684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159c145-fe86-4cab-b481-d939dbcef045 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:40.457353 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1193/2368] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:19:40.461583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d30af-1096-456e-9868-af9533d66fd0 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.472214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d30af-1096-456e-9868-af9533d66fd0 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.477611 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352cf0a-fa1c-4fff-8746-2c02c597c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.478251 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352cf0a-fa1c-4fff-8746-2c02c597c74f admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.478527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352cf0a-fa1c-4fff-8746-2c02c597c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.478796 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352cf0a-fa1c-4fff-8746-2c02c597c74f admin admin] PATH_INFO: `/v3/projects/ffe9dd2353a643fb8adeb7ac9e7de36e/users/52bd67a9312c49eeb21284a4ec55735f/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.494084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352cf0a-fa1c-4fff-8746-2c02c597c74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe9dd2353a643fb8adeb7ac9e7de36e, user_id=52bd67a9312c49eeb21284a4ec55735f, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.496800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352cf0a-fa1c-4fff-8746-2c02c597c74f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:40.511436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1176/2369] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:40 2022] PUT /identity/v3/projects/ffe9dd2353a643fb8adeb7ac9e7de36e/users/52bd67a9312c49eeb21284a4ec55735f/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:40.591094 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03147370-8f02-4750-a96f-27199c9a2224 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.591389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03147370-8f02-4750-a96f-27199c9a2224 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.591647 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03147370-8f02-4750-a96f-27199c9a2224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.628678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-03147370-8f02-4750-a96f-27199c9a2224 None None] MFA Rules not processed for user `52bd67a9312c49eeb21284a4ec55735f`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:40.629873 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-03147370-8f02-4750-a96f-27199c9a2224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:40.657738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:40.700746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1194/2370] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:40.705402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352cf0a-fa1c-4fff-8746-2c02c597c74f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.768125 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352cf0a-fa1c-4fff-8746-2c02c597c74f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.773938 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40126f1f-02a1-41cb-9c29-ccd4730617d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.774566 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126f1f-02a1-41cb-9c29-ccd4730617d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.774834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126f1f-02a1-41cb-9c29-ccd4730617d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.775105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126f1f-02a1-41cb-9c29-ccd4730617d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.775721 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40126f1f-02a1-41cb-9c29-ccd4730617d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.777659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40126f1f-02a1-41cb-9c29-ccd4730617d0 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:40.806627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1177/2371] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:40 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:40.811028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03147370-8f02-4750-a96f-27199c9a2224 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.821796 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03147370-8f02-4750-a96f-27199c9a2224 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.879340 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a47c1b-0329-4969-9a85-209e3a1dd248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.879947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a47c1b-0329-4969-9a85-209e3a1dd248 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.880223 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a47c1b-0329-4969-9a85-209e3a1dd248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.880521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a47c1b-0329-4969-9a85-209e3a1dd248 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.881147 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a47c1b-0329-4969-9a85-209e3a1dd248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.883093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a47c1b-0329-4969-9a85-209e3a1dd248 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:40.910350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1195/2372] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:40 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:40.911676 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40126f1f-02a1-41cb-9c29-ccd4730617d0 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.924336 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40126f1f-02a1-41cb-9c29-ccd4730617d0 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.930008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46828d-856a-4a9f-a3a4-cd9c0178115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.930597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46828d-856a-4a9f-a3a4-cd9c0178115f admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.930878 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46828d-856a-4a9f-a3a4-cd9c0178115f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.931148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46828d-856a-4a9f-a3a4-cd9c0178115f admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.931794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46828d-856a-4a9f-a3a4-cd9c0178115f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.933461 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46828d-856a-4a9f-a3a4-cd9c0178115f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:40.935587 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:40.949356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1178/2373] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:40.950997 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a47c1b-0329-4969-9a85-209e3a1dd248 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:40.961579 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a47c1b-0329-4969-9a85-209e3a1dd248 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:40.967322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557da02-259d-4b5f-a519-ce767b8f19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:40.968102 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557da02-259d-4b5f-a519-ce767b8f19de admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:40.968481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557da02-259d-4b5f-a519-ce767b8f19de admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:40.968860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557da02-259d-4b5f-a519-ce767b8f19de admin admin] PATH_INFO: `/v3/projects/169d176032bb40cc9422348a7928b8e3/users/1e30391fa19a46c8a881943d2d60f22f/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:40.985479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557da02-259d-4b5f-a519-ce767b8f19de admin admin] RBAC: Authorizing `identity:create_grant(project_id=169d176032bb40cc9422348a7928b8e3, user_id=1e30391fa19a46c8a881943d2d60f22f, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:40.988208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557da02-259d-4b5f-a519-ce767b8f19de admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:41.004758 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1196/2374] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:40 2022] PUT /identity/v3/projects/169d176032bb40cc9422348a7928b8e3/users/1e30391fa19a46c8a881943d2d60f22f/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:41.005987 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46828d-856a-4a9f-a3a4-cd9c0178115f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:41.016423 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46828d-856a-4a9f-a3a4-cd9c0178115f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:41.075036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884586d4-fd6c-4dc6-85fb-e1dd6aae0be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:41.075556 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884586d4-fd6c-4dc6-85fb-e1dd6aae0be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:41.075832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884586d4-fd6c-4dc6-85fb-e1dd6aae0be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:41.076102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884586d4-fd6c-4dc6-85fb-e1dd6aae0be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:41.076789 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884586d4-fd6c-4dc6-85fb-e1dd6aae0be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:41.078385 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884586d4-fd6c-4dc6-85fb-e1dd6aae0be8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:41.087880 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1179/2375] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:19:41.092100 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557da02-259d-4b5f-a519-ce767b8f19de admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:41.102850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557da02-259d-4b5f-a519-ce767b8f19de admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:41.107706 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e53a3d-923d-4361-8462-61e73c718096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:41.108746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e53a3d-923d-4361-8462-61e73c718096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:41.109200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e53a3d-923d-4361-8462-61e73c718096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:41.109504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e53a3d-923d-4361-8462-61e73c718096 admin admin] PATH_INFO: `/v3/projects/169d176032bb40cc9422348a7928b8e3/users/1e30391fa19a46c8a881943d2d60f22f/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:41.111679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e53a3d-923d-4361-8462-61e73c718096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169d176032bb40cc9422348a7928b8e3, user_id=1e30391fa19a46c8a881943d2d60f22f, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:41.114388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e53a3d-923d-4361-8462-61e73c718096 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:41.125651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1197/2376] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:41 2022] PUT /identity/v3/projects/169d176032bb40cc9422348a7928b8e3/users/1e30391fa19a46c8a881943d2d60f22f/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:41.136058 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1eb2-6b8f-420a-ad5c-16f3ea9f3aeb None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:41.136324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1eb2-6b8f-420a-ad5c-16f3ea9f3aeb None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:41.136623 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1eb2-6b8f-420a-ad5c-16f3ea9f3aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:41.166224 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-97fb1eb2-6b8f-420a-ad5c-16f3ea9f3aeb None None] MFA Rules not processed for user `1e30391fa19a46c8a881943d2d60f22f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:41.167466 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-97fb1eb2-6b8f-420a-ad5c-16f3ea9f3aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:41.248885 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1180/2377] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:41.261045 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e53a3d-923d-4361-8462-61e73c718096 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:41.262996 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f1e53a3d-923d-4361-8462-61e73c718096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:41.325025 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e53a3d-923d-4361-8462-61e73c718096 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:41.329675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d11cb2-f1c6-4b8c-9613-f0c2e80e556e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:41.330226 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d11cb2-f1c6-4b8c-9613-f0c2e80e556e service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:41.330544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d11cb2-f1c6-4b8c-9613-f0c2e80e556e service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:41.330801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d11cb2-f1c6-4b8c-9613-f0c2e80e556e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:41.341019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d11cb2-f1c6-4b8c-9613-f0c2e80e556e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:41.342477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d11cb2-f1c6-4b8c-9613-f0c2e80e556e service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:41.352410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1198/2378] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:41.403041 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1eb2-6b8f-420a-ad5c-16f3ea9f3aeb None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:41.404597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-97fb1eb2-6b8f-420a-ad5c-16f3ea9f3aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:41.417293 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1eb2-6b8f-420a-ad5c-16f3ea9f3aeb None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:41.421151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2f12f-efb3-43bc-bb50-4066f6e5703a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:41.421770 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2f12f-efb3-43bc-bb50-4066f6e5703a service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:41.422167 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2f12f-efb3-43bc-bb50-4066f6e5703a service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:41.422442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2f12f-efb3-43bc-bb50-4066f6e5703a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:41.480051 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2f12f-efb3-43bc-bb50-4066f6e5703a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:41.481527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2f12f-efb3-43bc-bb50-4066f6e5703a service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:41.490768 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1181/2379] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:44.440382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d11cb2-f1c6-4b8c-9613-f0c2e80e556e service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:44.466265 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:44.506197 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d11cb2-f1c6-4b8c-9613-f0c2e80e556e service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:44.511386 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:44.512008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:44.512286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:44.512592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] PATH_INFO: `/v3/users/109c7ad653294988bafc0d8dee5ab6a1` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:44.513721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109c7ad653294988bafc0d8dee5ab6a1)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:44.515640 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:44.565085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109c7ad653294988bafc0d8dee5ab6a1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:44.572403 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109c7ad653294988bafc0d8dee5ab6a1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:44.573082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109c7ad653294988bafc0d8dee5ab6a1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:44.586835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109c7ad653294988bafc0d8dee5ab6a1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:44.587864 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109c7ad653294988bafc0d8dee5ab6a1'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:44.605069 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1199/2380] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:44 2022] DELETE /identity/v3/users/109c7ad653294988bafc0d8dee5ab6a1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:44.610007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee75a7-1cbf-4830-bb91-2b6b6e142d1c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:44.610515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee75a7-1cbf-4830-bb91-2b6b6e142d1c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:44.610614 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee75a7-1cbf-4830-bb91-2b6b6e142d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:44.629854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c1ee75a7-1cbf-4830-bb91-2b6b6e142d1c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:44.631175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c1ee75a7-1cbf-4830-bb91-2b6b6e142d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:44.643215 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:44.692021 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1182/2381] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:44.701924 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:44.703468 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:44.763716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547798fd-f87a-48bb-b4d6-367d48dde071 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:44.768763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da87dd-da27-4384-846d-0ff533aae2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:44.769403 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da87dd-da27-4384-846d-0ff533aae2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:44.769680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da87dd-da27-4384-846d-0ff533aae2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:44.769947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da87dd-da27-4384-846d-0ff533aae2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:44.779896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da87dd-da27-4384-846d-0ff533aae2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:44.781354 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da87dd-da27-4384-846d-0ff533aae2f9 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:44.791103 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1200/2382] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:45.061732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee75a7-1cbf-4830-bb91-2b6b6e142d1c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:45.063175 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c1ee75a7-1cbf-4830-bb91-2b6b6e142d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:45.076103 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee75a7-1cbf-4830-bb91-2b6b6e142d1c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:45.081606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:45.082951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:45.083201 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:45.083481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] PATH_INFO: `/v3/projects/d9918b0b0748483f9284a7c956737051` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:45.085080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9918b0b0748483f9284a7c956737051)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:45.086998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:45.137397 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9918b0b0748483f9284a7c956737051', 'request_id': 'req-99fda2aa-5900-4fad-9ce1-7af28f45bf39'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.146197 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9918b0b0748483f9284a7c956737051', 'request_id': 'req-99fda2aa-5900-4fad-9ce1-7af28f45bf39'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.152830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9918b0b0748483f9284a7c956737051', 'request_id': 'req-99fda2aa-5900-4fad-9ce1-7af28f45bf39'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.164094 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] The token cache is being invalidate because project d9918b0b0748483f9284a7c956737051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:45.164403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.165118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.166708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1183/2383] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:45 2022] DELETE /identity/v3/projects/d9918b0b0748483f9284a7c956737051 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:45.171214 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da87dd-da27-4384-846d-0ff533aae2f9 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:45.181309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da87dd-da27-4384-846d-0ff533aae2f9 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:45.225633 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:45.246088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:45.246709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:45.246984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:45.247238 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] PATH_INFO: `/v3/users/52bd67a9312c49eeb21284a4ec55735f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:45.248437 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52bd67a9312c49eeb21284a4ec55735f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:45.250388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:45.298100 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52bd67a9312c49eeb21284a4ec55735f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.305099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52bd67a9312c49eeb21284a4ec55735f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.305760 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52bd67a9312c49eeb21284a4ec55735f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.317542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52bd67a9312c49eeb21284a4ec55735f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.318199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52bd67a9312c49eeb21284a4ec55735f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.333525 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1201/2384] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:45 2022] DELETE /identity/v3/users/52bd67a9312c49eeb21284a4ec55735f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:45.609529 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:45.611108 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:45.627760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda2aa-5900-4fad-9ce1-7af28f45bf39 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:45.686232 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:45.686788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:45.687065 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:45.687341 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] PATH_INFO: `/v3/projects/ffe9dd2353a643fb8adeb7ac9e7de36e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:45.688503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe9dd2353a643fb8adeb7ac9e7de36e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:45.690418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:45.737338 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:45.741361 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe9dd2353a643fb8adeb7ac9e7de36e', 'request_id': 'req-d7fb650a-408f-4c72-b28c-c6e3d25d8185'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.749387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe9dd2353a643fb8adeb7ac9e7de36e', 'request_id': 'req-d7fb650a-408f-4c72-b28c-c6e3d25d8185'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.755926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe9dd2353a643fb8adeb7ac9e7de36e', 'request_id': 'req-d7fb650a-408f-4c72-b28c-c6e3d25d8185'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.766362 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] The token cache is being invalidate because project ffe9dd2353a643fb8adeb7ac9e7de36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:45.766642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.767282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.768792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1184/2385] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:45 2022] DELETE /identity/v3/projects/ffe9dd2353a643fb8adeb7ac9e7de36e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:45.772950 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:45.774431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:45.787084 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7135b-fbb7-4cd0-b3e0-d12afe701f31 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:45.844972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:45.845632 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:45.845909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:45.846183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] PATH_INFO: `/v3/users/1e30391fa19a46c8a881943d2d60f22f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:45.847450 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e30391fa19a46c8a881943d2d60f22f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:45.850191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:45.905156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e30391fa19a46c8a881943d2d60f22f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.911988 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e30391fa19a46c8a881943d2d60f22f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.912684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e30391fa19a46c8a881943d2d60f22f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.919877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:45.925861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e30391fa19a46c8a881943d2d60f22f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.926730 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-b9104dd3-ee4d-459b-9dcc-9f4138cba502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e30391fa19a46c8a881943d2d60f22f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:45.942267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1202/2386] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:45 2022] DELETE /identity/v3/users/1e30391fa19a46c8a881943d2d60f22f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:46.217982 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:46.222080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:46.250500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb650a-408f-4c72-b28c-c6e3d25d8185 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:46.309944 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:46.310577 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:46.310873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:46.311145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] PATH_INFO: `/v3/projects/169d176032bb40cc9422348a7928b8e3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:46.312249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169d176032bb40cc9422348a7928b8e3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:46.314273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:46.365253 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169d176032bb40cc9422348a7928b8e3', 'request_id': 'req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:46.374262 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169d176032bb40cc9422348a7928b8e3', 'request_id': 'req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:46.381553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169d176032bb40cc9422348a7928b8e3', 'request_id': 'req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:46.393463 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] The token cache is being invalidate because project 169d176032bb40cc9422348a7928b8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:46.393754 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:46.394494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b871fd81-fa6c-4af6-ac07-4a67e8a294e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:46.396086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1185/2387] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:46 2022] DELETE /identity/v3/projects/169d176032bb40cc9422348a7928b8e3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:46.402255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421211cd-52cf-44f3-9ad6-77f2a6acbc5f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:46.402593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421211cd-52cf-44f3-9ad6-77f2a6acbc5f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:46.402806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421211cd-52cf-44f3-9ad6-77f2a6acbc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:46.422598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-421211cd-52cf-44f3-9ad6-77f2a6acbc5f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:46.423853 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-421211cd-52cf-44f3-9ad6-77f2a6acbc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:46.485894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1203/2388] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:46.495788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76b3d2-7e58-4b12-a282-0d945c156898 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:46.496076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76b3d2-7e58-4b12-a282-0d945c156898 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:46.496375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76b3d2-7e58-4b12-a282-0d945c156898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:46.517127 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-aa76b3d2-7e58-4b12-a282-0d945c156898 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:46.518335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-aa76b3d2-7e58-4b12-a282-0d945c156898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:46.527690 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1186/2389] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:46.532162 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421211cd-52cf-44f3-9ad6-77f2a6acbc5f None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:46.542521 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421211cd-52cf-44f3-9ad6-77f2a6acbc5f None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:46.548515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55a124-c390-43f5-82a9-26f40afb61d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:46.549121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55a124-c390-43f5-82a9-26f40afb61d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:46.549436 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55a124-c390-43f5-82a9-26f40afb61d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:46.549729 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55a124-c390-43f5-82a9-26f40afb61d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:46.550381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55a124-c390-43f5-82a9-26f40afb61d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:19:46.550685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55a124-c390-43f5-82a9-26f40afb61d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:46.552329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55a124-c390-43f5-82a9-26f40afb61d2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:46.564869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1204/2390] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:19:46.570096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76b3d2-7e58-4b12-a282-0d945c156898 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:46.579086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76b3d2-7e58-4b12-a282-0d945c156898 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:46.585374 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426e8c-c492-4516-87de-9a1d19efa03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:46.585991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426e8c-c492-4516-87de-9a1d19efa03f admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:46.586267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426e8c-c492-4516-87de-9a1d19efa03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:46.586536 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426e8c-c492-4516-87de-9a1d19efa03f admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:46.587174 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd426e8c-c492-4516-87de-9a1d19efa03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:46.589164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd426e8c-c492-4516-87de-9a1d19efa03f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:46.620424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1187/2391] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:46 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:46.625565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55a124-c390-43f5-82a9-26f40afb61d2 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:46.637169 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55a124-c390-43f5-82a9-26f40afb61d2 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:46.697675 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce8514-5765-488a-a1e1-27011e169dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:46.698318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce8514-5765-488a-a1e1-27011e169dba admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:46.698599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce8514-5765-488a-a1e1-27011e169dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:46.698874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce8514-5765-488a-a1e1-27011e169dba admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:46.699510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce8514-5765-488a-a1e1-27011e169dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:46.701480 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce8514-5765-488a-a1e1-27011e169dba admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:46.724099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1205/2392] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:46 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:46.728365 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426e8c-c492-4516-87de-9a1d19efa03f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:46.739120 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426e8c-c492-4516-87de-9a1d19efa03f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:46.743842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542904ea-69e2-4365-aff5-741c9ecee554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:46.744483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542904ea-69e2-4365-aff5-741c9ecee554 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:46.744749 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542904ea-69e2-4365-aff5-741c9ecee554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:46.745021 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542904ea-69e2-4365-aff5-741c9ecee554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:46.745670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542904ea-69e2-4365-aff5-741c9ecee554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:46.747492 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542904ea-69e2-4365-aff5-741c9ecee554 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:46.757939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1188/2393] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:46.761931 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce8514-5765-488a-a1e1-27011e169dba admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:46.772558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce8514-5765-488a-a1e1-27011e169dba admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:46.777860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96811e-d4e5-40d1-8c94-3c06b34dec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:46.778465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96811e-d4e5-40d1-8c94-3c06b34dec60 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:46.778747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96811e-d4e5-40d1-8c94-3c06b34dec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:46.779022 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96811e-d4e5-40d1-8c94-3c06b34dec60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:46.779669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96811e-d4e5-40d1-8c94-3c06b34dec60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:46.781313 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96811e-d4e5-40d1-8c94-3c06b34dec60 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:46.792214 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1206/2394] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:46.796268 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542904ea-69e2-4365-aff5-741c9ecee554 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:46.806350 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542904ea-69e2-4365-aff5-741c9ecee554 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:46.811420 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b546832-2ffb-4c24-895a-595089f913b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:46.812072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b546832-2ffb-4c24-895a-595089f913b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:46.812360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b546832-2ffb-4c24-895a-595089f913b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:46.812647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b546832-2ffb-4c24-895a-595089f913b7 admin admin] PATH_INFO: `/v3/projects/ffe27ecf0b0843b78e01b553382f036c/users/6204302d0344427e9136981333cd2464/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:46.829096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b546832-2ffb-4c24-895a-595089f913b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe27ecf0b0843b78e01b553382f036c, user_id=6204302d0344427e9136981333cd2464, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:46.831795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b546832-2ffb-4c24-895a-595089f913b7 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:46.841324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:46.851983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1189/2395] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:46 2022] PUT /identity/v3/projects/ffe27ecf0b0843b78e01b553382f036c/users/6204302d0344427e9136981333cd2464/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:46.863806 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c077a3-27dc-4610-99c4-96677ad95f05 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:46.864094 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c077a3-27dc-4610-99c4-96677ad95f05 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:46.864395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c077a3-27dc-4610-99c4-96677ad95f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:46.893557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-07c077a3-27dc-4610-99c4-96677ad95f05 None None] MFA Rules not processed for user `6204302d0344427e9136981333cd2464`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:46.894766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-07c077a3-27dc-4610-99c4-96677ad95f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:46.939402 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:46.967892 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1207/2396] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:46.972668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b546832-2ffb-4c24-895a-595089f913b7 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.041726 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b546832-2ffb-4c24-895a-595089f913b7 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.047782 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12359957-57f5-49d0-814f-6f6a681995c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.048388 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12359957-57f5-49d0-814f-6f6a681995c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.048668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12359957-57f5-49d0-814f-6f6a681995c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.048936 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12359957-57f5-49d0-814f-6f6a681995c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.049568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12359957-57f5-49d0-814f-6f6a681995c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.051495 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12359957-57f5-49d0-814f-6f6a681995c6 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.081212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1190/2397] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:46 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:47.085453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c077a3-27dc-4610-99c4-96677ad95f05 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.096507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c077a3-27dc-4610-99c4-96677ad95f05 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.154156 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902305e-c93d-4715-a3d5-75be794b514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.154805 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902305e-c93d-4715-a3d5-75be794b514b admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.155081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902305e-c93d-4715-a3d5-75be794b514b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.155352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902305e-c93d-4715-a3d5-75be794b514b admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.155982 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902305e-c93d-4715-a3d5-75be794b514b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.157968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902305e-c93d-4715-a3d5-75be794b514b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.181505 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1208/2398] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:47 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:47.185602 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12359957-57f5-49d0-814f-6f6a681995c6 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.196148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12359957-57f5-49d0-814f-6f6a681995c6 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.201910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe481-f90b-4186-840d-8f32b726b01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.202504 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe481-f90b-4186-840d-8f32b726b01a admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.202764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe481-f90b-4186-840d-8f32b726b01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.203026 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe481-f90b-4186-840d-8f32b726b01a admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.203661 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fe481-f90b-4186-840d-8f32b726b01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.205299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fe481-f90b-4186-840d-8f32b726b01a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.216179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1191/2399] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:47.220043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902305e-c93d-4715-a3d5-75be794b514b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.230683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902305e-c93d-4715-a3d5-75be794b514b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.236242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f4dc7-47d2-43fe-8d37-aacf1fdb706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.236860 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f4dc7-47d2-43fe-8d37-aacf1fdb706b admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.237268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f4dc7-47d2-43fe-8d37-aacf1fdb706b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.237530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f4dc7-47d2-43fe-8d37-aacf1fdb706b admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.238175 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f4dc7-47d2-43fe-8d37-aacf1fdb706b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.239757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f4dc7-47d2-43fe-8d37-aacf1fdb706b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.249822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1209/2400] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:19:47.254102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe481-f90b-4186-840d-8f32b726b01a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.263830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe481-f90b-4186-840d-8f32b726b01a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.269157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d32c9-a30e-4813-b288-5f89a3269132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.269813 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d32c9-a30e-4813-b288-5f89a3269132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.270087 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d32c9-a30e-4813-b288-5f89a3269132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.270352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d32c9-a30e-4813-b288-5f89a3269132 admin admin] PATH_INFO: `/v3/projects/629cbb3918c847d4b77b324bbd482124/users/7f3f24f0e1624c969c4cdb5db1d6f720/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.285628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d32c9-a30e-4813-b288-5f89a3269132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629cbb3918c847d4b77b324bbd482124, user_id=7f3f24f0e1624c969c4cdb5db1d6f720, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.288281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d32c9-a30e-4813-b288-5f89a3269132 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.303656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1192/2401] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:47 2022] PUT /identity/v3/projects/629cbb3918c847d4b77b324bbd482124/users/7f3f24f0e1624c969c4cdb5db1d6f720/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:47.314880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab318b2-2534-4a1d-a075-2e1905735cb8 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.315189 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab318b2-2534-4a1d-a075-2e1905735cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.315548 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab318b2-2534-4a1d-a075-2e1905735cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.350409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-fab318b2-2534-4a1d-a075-2e1905735cb8 None None] MFA Rules not processed for user `7f3f24f0e1624c969c4cdb5db1d6f720`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:47.351721 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-fab318b2-2534-4a1d-a075-2e1905735cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:47.418294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1210/2402] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:19:47.423057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d32c9-a30e-4813-b288-5f89a3269132 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.489724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d32c9-a30e-4813-b288-5f89a3269132 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.494751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee097965-5549-494a-978d-74375f0a3adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.495354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee097965-5549-494a-978d-74375f0a3adb admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.495629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee097965-5549-494a-978d-74375f0a3adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.495932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee097965-5549-494a-978d-74375f0a3adb admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.496626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee097965-5549-494a-978d-74375f0a3adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.498526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee097965-5549-494a-978d-74375f0a3adb admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.526955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1193/2403] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:47 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:47.531630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab318b2-2534-4a1d-a075-2e1905735cb8 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.542353 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab318b2-2534-4a1d-a075-2e1905735cb8 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.587795 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:47.600927 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee4730-f4fa-4c0a-858e-150797092a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.601573 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4730-f4fa-4c0a-858e-150797092a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.601850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4730-f4fa-4c0a-858e-150797092a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.602118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4730-f4fa-4c0a-858e-150797092a89 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.602782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee4730-f4fa-4c0a-858e-150797092a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.604748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee4730-f4fa-4c0a-858e-150797092a89 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.628787 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1211/2404] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:47 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:19:47.632985 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee097965-5549-494a-978d-74375f0a3adb admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.643279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee097965-5549-494a-978d-74375f0a3adb admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.647874 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e9cb7-b615-4986-834f-83e438fa9ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.648509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e9cb7-b615-4986-834f-83e438fa9ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.648786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e9cb7-b615-4986-834f-83e438fa9ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.649057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e9cb7-b615-4986-834f-83e438fa9ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.649698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e9cb7-b615-4986-834f-83e438fa9ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.651335 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e9cb7-b615-4986-834f-83e438fa9ed5 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.661718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1194/2405] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:47.666214 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee4730-f4fa-4c0a-858e-150797092a89 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.676886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee4730-f4fa-4c0a-858e-150797092a89 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.682318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcb09d-cc08-40d9-be04-0588c12b4eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.682999 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcb09d-cc08-40d9-be04-0588c12b4eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.683275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcb09d-cc08-40d9-be04-0588c12b4eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.683542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcb09d-cc08-40d9-be04-0588c12b4eb8 admin admin] PATH_INFO: `/v3/projects/f689503ce5ca4fa68191b5f832d4ed08/users/9174aa7445c24243a600221b5c7c250e/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.699503 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcb09d-cc08-40d9-be04-0588c12b4eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f689503ce5ca4fa68191b5f832d4ed08, user_id=9174aa7445c24243a600221b5c7c250e, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.702200 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcb09d-cc08-40d9-be04-0588c12b4eb8 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.718307 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1212/2406] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:47 2022] PUT /identity/v3/projects/f689503ce5ca4fa68191b5f832d4ed08/users/9174aa7445c24243a600221b5c7c250e/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:47.722706 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e9cb7-b615-4986-834f-83e438fa9ed5 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.732918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e9cb7-b615-4986-834f-83e438fa9ed5 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.751328 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:47.789391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee58e83-2843-4c73-beff-80a735d150f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.789988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58e83-2843-4c73-beff-80a735d150f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.790259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58e83-2843-4c73-beff-80a735d150f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.790526 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58e83-2843-4c73-beff-80a735d150f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.791154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee58e83-2843-4c73-beff-80a735d150f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.792790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee58e83-2843-4c73-beff-80a735d150f2 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.803099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1195/2407] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:47.807578 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcb09d-cc08-40d9-be04-0588c12b4eb8 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.818508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcb09d-cc08-40d9-be04-0588c12b4eb8 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:47.823979 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43605036-1880-4650-b1a8-0caa2ec3b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:47.824679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43605036-1880-4650-b1a8-0caa2ec3b63d admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.824957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43605036-1880-4650-b1a8-0caa2ec3b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.825213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43605036-1880-4650-b1a8-0caa2ec3b63d admin admin] PATH_INFO: `/v3/projects/f689503ce5ca4fa68191b5f832d4ed08/users/9174aa7445c24243a600221b5c7c250e/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.827337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43605036-1880-4650-b1a8-0caa2ec3b63d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f689503ce5ca4fa68191b5f832d4ed08, user_id=9174aa7445c24243a600221b5c7c250e, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:47.830054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43605036-1880-4650-b1a8-0caa2ec3b63d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:47.856634 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe5362-43c6-4ebb-801e-ac86dc4a754d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:47.856886 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1213/2408] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:47 2022] PUT /identity/v3/projects/f689503ce5ca4fa68191b5f832d4ed08/users/9174aa7445c24243a600221b5c7c250e/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:47.857549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe5362-43c6-4ebb-801e-ac86dc4a754d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:47.858024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe5362-43c6-4ebb-801e-ac86dc4a754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:47.889623 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-cebe5362-43c6-4ebb-801e-ac86dc4a754d None None] MFA Rules not processed for user `9174aa7445c24243a600221b5c7c250e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:47.890842 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cebe5362-43c6-4ebb-801e-ac86dc4a754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:47.960791 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1196/2409] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:19:47.973118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43605036-1880-4650-b1a8-0caa2ec3b63d admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:47.975035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-43605036-1880-4650-b1a8-0caa2ec3b63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:48.038982 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43605036-1880-4650-b1a8-0caa2ec3b63d admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:48.043047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c2c9d-47fb-4dd4-b15b-6f547d0cb13e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:48.043677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c2c9d-47fb-4dd4-b15b-6f547d0cb13e service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:48.043955 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c2c9d-47fb-4dd4-b15b-6f547d0cb13e service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:48.044227 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c2c9d-47fb-4dd4-b15b-6f547d0cb13e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:48.105656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c2c9d-47fb-4dd4-b15b-6f547d0cb13e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:48.107020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c2c9d-47fb-4dd4-b15b-6f547d0cb13e service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:48.117491 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1214/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:49.654740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe5362-43c6-4ebb-801e-ac86dc4a754d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:49.656247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cebe5362-43c6-4ebb-801e-ac86dc4a754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:49.669689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe5362-43c6-4ebb-801e-ac86dc4a754d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:49.673474 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0b5d4-5d37-425f-bd7c-e18db3105d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:49.674083 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0b5d4-5d37-425f-bd7c-e18db3105d9b service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:49.674361 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0b5d4-5d37-425f-bd7c-e18db3105d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:49.674631 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0b5d4-5d37-425f-bd7c-e18db3105d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:49.735998 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0b5d4-5d37-425f-bd7c-e18db3105d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:49.737830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0b5d4-5d37-425f-bd7c-e18db3105d9b service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:49.748409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1197/2411] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:50.383553 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c2c9d-47fb-4dd4-b15b-6f547d0cb13e service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:50.392479 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c2c9d-47fb-4dd4-b15b-6f547d0cb13e service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:50.396701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22196324-ac52-4892-881d-9e9529f6935b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:50.397305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196324-ac52-4892-881d-9e9529f6935b service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:50.397688 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196324-ac52-4892-881d-9e9529f6935b service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:50.397956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196324-ac52-4892-881d-9e9529f6935b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:50.407401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22196324-ac52-4892-881d-9e9529f6935b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:50.408896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22196324-ac52-4892-881d-9e9529f6935b service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:50.418322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1215/2412] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:53.160104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0b5d4-5d37-425f-bd7c-e18db3105d9b service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:53.161515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-41d0b5d4-5d37-425f-bd7c-e18db3105d9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:53.212847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:53.228174 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0b5d4-5d37-425f-bd7c-e18db3105d9b service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:53.232025 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b2e86-b9a3-43e7-8090-7819c0498ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:53.232668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2e86-b9a3-43e7-8090-7819c0498ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:53.232946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2e86-b9a3-43e7-8090-7819c0498ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:53.233560 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2e86-b9a3-43e7-8090-7819c0498ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:53.235364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-861b2e86-b9a3-43e7-8090-7819c0498ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:53.302507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b2e86-b9a3-43e7-8090-7819c0498ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:53.304000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b2e86-b9a3-43e7-8090-7819c0498ad7 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:53.313751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1198/2413] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:54.338519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22196324-ac52-4892-881d-9e9529f6935b service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:54.351183 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22196324-ac52-4892-881d-9e9529f6935b service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:54.355781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:54.356462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:54.356742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:54.357021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] PATH_INFO: `/v3/users/6204302d0344427e9136981333cd2464` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:54.358500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6204302d0344427e9136981333cd2464)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:54.360470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:54.429142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:54.448014 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6204302d0344427e9136981333cd2464'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:54.456510 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6204302d0344427e9136981333cd2464'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:54.457266 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6204302d0344427e9136981333cd2464'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:54.470062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6204302d0344427e9136981333cd2464'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:54.470682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6204302d0344427e9136981333cd2464'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:54.485290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1216/2414] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:54 2022] DELETE /identity/v3/users/6204302d0344427e9136981333cd2464 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:54.490561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ddc7a-3957-4493-a2b0-bb3ffd579a92 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:54.491045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ddc7a-3957-4493-a2b0-bb3ffd579a92 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:54.491130 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ddc7a-3957-4493-a2b0-bb3ffd579a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:54.516198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-cf3ddc7a-3957-4493-a2b0-bb3ffd579a92 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:54.517558 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cf3ddc7a-3957-4493-a2b0-bb3ffd579a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:54.598000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1199/2415] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:54.605151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:54.606274 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:54.671194 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f07f9-3ee3-4196-ad84-056661335f85 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:54.676137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463d171-9db2-4bc1-b4b6-80b35897882f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:54.676888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463d171-9db2-4bc1-b4b6-80b35897882f service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:54.677778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463d171-9db2-4bc1-b4b6-80b35897882f service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:54.677778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463d171-9db2-4bc1-b4b6-80b35897882f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:54.689770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463d171-9db2-4bc1-b4b6-80b35897882f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:54.691261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463d171-9db2-4bc1-b4b6-80b35897882f service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:54.702088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1217/2416] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:55.150544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ddc7a-3957-4493-a2b0-bb3ffd579a92 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:55.152873 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cf3ddc7a-3957-4493-a2b0-bb3ffd579a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:55.175244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ddc7a-3957-4493-a2b0-bb3ffd579a92 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:55.180433 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:55.181115 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:55.181390 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:55.181658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] PATH_INFO: `/v3/projects/ffe27ecf0b0843b78e01b553382f036c` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:55.183158 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe27ecf0b0843b78e01b553382f036c)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:55.184748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:55.245680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe27ecf0b0843b78e01b553382f036c', 'request_id': 'req-56e384e3-9645-4385-a8da-b0989cda861a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.260411 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe27ecf0b0843b78e01b553382f036c', 'request_id': 'req-56e384e3-9645-4385-a8da-b0989cda861a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.271207 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe27ecf0b0843b78e01b553382f036c', 'request_id': 'req-56e384e3-9645-4385-a8da-b0989cda861a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.294413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] The token cache is being invalidate because project ffe27ecf0b0843b78e01b553382f036c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:55.294797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.295519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.297414 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1200/2417] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:55 2022] DELETE /identity/v3/projects/ffe27ecf0b0843b78e01b553382f036c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:55.302149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463d171-9db2-4bc1-b4b6-80b35897882f service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:55.317079 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463d171-9db2-4bc1-b4b6-80b35897882f service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:55.375989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:55.376754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:55.377021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:55.377323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] PATH_INFO: `/v3/users/7f3f24f0e1624c969c4cdb5db1d6f720` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:55.378661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3f24f0e1624c969c4cdb5db1d6f720)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:55.380668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:55.434137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3f24f0e1624c969c4cdb5db1d6f720'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.441427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3f24f0e1624c969c4cdb5db1d6f720'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.442099 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3f24f0e1624c969c4cdb5db1d6f720'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.443246 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:55.458071 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3f24f0e1624c969c4cdb5db1d6f720'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.458935 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3f24f0e1624c969c4cdb5db1d6f720'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.472447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1218/2418] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:55 2022] DELETE /identity/v3/users/7f3f24f0e1624c969c4cdb5db1d6f720 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:55.767894 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:55.770281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:55.785959 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e384e3-9645-4385-a8da-b0989cda861a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:55.799786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:55.849797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:55.850521 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:55.851171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:55.851626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] PATH_INFO: `/v3/projects/629cbb3918c847d4b77b324bbd482124` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:55.853028 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629cbb3918c847d4b77b324bbd482124)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:55.855124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:55.905945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629cbb3918c847d4b77b324bbd482124', 'request_id': 'req-83514e7f-acec-4f42-bd88-f3d6ff6451b8'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.916732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629cbb3918c847d4b77b324bbd482124', 'request_id': 'req-83514e7f-acec-4f42-bd88-f3d6ff6451b8'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.925207 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629cbb3918c847d4b77b324bbd482124', 'request_id': 'req-83514e7f-acec-4f42-bd88-f3d6ff6451b8'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.938629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] The token cache is being invalidate because project 629cbb3918c847d4b77b324bbd482124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:55.938950 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.940370 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:55.945629 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1201/2419] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:55 2022] DELETE /identity/v3/projects/629cbb3918c847d4b77b324bbd482124 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:55.946842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:55.948384 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:55.962761 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc0ae-200f-47f0-a4c8-d3e7001ad79f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:56.041986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:56.043107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:56.043395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:56.043676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] PATH_INFO: `/v3/users/9174aa7445c24243a600221b5c7c250e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:56.045889 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9174aa7445c24243a600221b5c7c250e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:56.048026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:56.113371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9174aa7445c24243a600221b5c7c250e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.122023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9174aa7445c24243a600221b5c7c250e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.122994 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9174aa7445c24243a600221b5c7c250e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.145891 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9174aa7445c24243a600221b5c7c250e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.146815 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9174aa7445c24243a600221b5c7c250e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.167666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1219/2420] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:55 2022] DELETE /identity/v3/users/9174aa7445c24243a600221b5c7c250e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:56.502962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:56.504889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:56.526524 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514e7f-acec-4f42-bd88-f3d6ff6451b8 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:56.573088 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:56.575299 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:56.607875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:56.609043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:56.609311 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:56.609576 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] PATH_INFO: `/v3/projects/f689503ce5ca4fa68191b5f832d4ed08` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:56.610696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f689503ce5ca4fa68191b5f832d4ed08)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:56.612678 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:56.636715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:56.653211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aabe3-3e11-4c1b-8d81-c7682ba82243 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:56.669517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:56.670929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f689503ce5ca4fa68191b5f832d4ed08', 'request_id': 'req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.679739 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f689503ce5ca4fa68191b5f832d4ed08', 'request_id': 'req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.686716 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f689503ce5ca4fa68191b5f832d4ed08', 'request_id': 'req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.697571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] The token cache is being invalidate because project f689503ce5ca4fa68191b5f832d4ed08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:56.697856 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.698579 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-b7403fce-60de-4d1e-a1d2-7d1ba0f673bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.700089 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1202/2421] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:56 2022] DELETE /identity/v3/projects/f689503ce5ca4fa68191b5f832d4ed08 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:56.705214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b616cb7-61cd-4225-b6e8-94fcdc7c6e24 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:56.705500 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b616cb7-61cd-4225-b6e8-94fcdc7c6e24 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:56.705888 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b616cb7-61cd-4225-b6e8-94fcdc7c6e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:56.713752 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:56.714423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:56.714701 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:56.714973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] PATH_INFO: `/v3/users/51360e31ecb2426aaa32981a54f71fad` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:56.716086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51360e31ecb2426aaa32981a54f71fad)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:56.718068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:56.726198 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3b616cb7-61cd-4225-b6e8-94fcdc7c6e24 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:56.727418 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3b616cb7-61cd-4225-b6e8-94fcdc7c6e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:56.736003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1203/2422] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:19:56.743708 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40f515-2ba2-403c-84d9-be861529d10e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:56.743993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40f515-2ba2-403c-84d9-be861529d10e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:56.744261 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40f515-2ba2-403c-84d9-be861529d10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:56.765072 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-fa40f515-2ba2-403c-84d9-be861529d10e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:56.766284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fa40f515-2ba2-403c-84d9-be861529d10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:56.767638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51360e31ecb2426aaa32981a54f71fad'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.774195 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1204/2423] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:19:56.775173 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51360e31ecb2426aaa32981a54f71fad'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.775850 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51360e31ecb2426aaa32981a54f71fad'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.778377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40f515-2ba2-403c-84d9-be861529d10e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:56.787811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40f515-2ba2-403c-84d9-be861529d10e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:56.788838 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51360e31ecb2426aaa32981a54f71fad'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.789496 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51360e31ecb2426aaa32981a54f71fad'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:56.792421 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535e0fd-e742-4172-958b-10c1918f6e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:56.793043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535e0fd-e742-4172-958b-10c1918f6e44 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:56.793358 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535e0fd-e742-4172-958b-10c1918f6e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:56.793637 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535e0fd-e742-4172-958b-10c1918f6e44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:56.794331 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535e0fd-e742-4172-958b-10c1918f6e44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:19:56.794719 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535e0fd-e742-4172-958b-10c1918f6e44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:56.796743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535e0fd-e742-4172-958b-10c1918f6e44 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:56.803738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1220/2424] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:56 2022] DELETE /identity/v3/users/51360e31ecb2426aaa32981a54f71fad => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:56.811086 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1205/2425] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:19:56.815285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:56.817047 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:56.890874 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d2e1-466d-48aa-9a4f-d81e53dbeec3 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:56.895415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f2235-257c-49b2-8c5e-dac35427e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:56.896051 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f2235-257c-49b2-8c5e-dac35427e262 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:56.896356 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f2235-257c-49b2-8c5e-dac35427e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:56.896629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f2235-257c-49b2-8c5e-dac35427e262 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:56.897257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f2235-257c-49b2-8c5e-dac35427e262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:56.899190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f2235-257c-49b2-8c5e-dac35427e262 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:56.929334 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1221/2426] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:56 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:56.930878 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535e0fd-e742-4172-958b-10c1918f6e44 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:56.941023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535e0fd-e742-4172-958b-10c1918f6e44 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:56.979940 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f2235-257c-49b2-8c5e-dac35427e262 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:56.981765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f16f2235-257c-49b2-8c5e-dac35427e262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:56.990261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:57.004760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e37317-462b-4c69-aa51-9ffd5f5b3ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.005386 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e37317-462b-4c69-aa51-9ffd5f5b3ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.005662 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e37317-462b-4c69-aa51-9ffd5f5b3ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.005932 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e37317-462b-4c69-aa51-9ffd5f5b3ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.006569 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e37317-462b-4c69-aa51-9ffd5f5b3ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.008925 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e37317-462b-4c69-aa51-9ffd5f5b3ed9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.030589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1206/2427] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:56 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:19:57.034590 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e37317-462b-4c69-aa51-9ffd5f5b3ed9 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.044368 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e37317-462b-4c69-aa51-9ffd5f5b3ed9 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.048784 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb34d7-0b44-436d-874f-011b5ac39679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.049367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb34d7-0b44-436d-874f-011b5ac39679 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.049643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb34d7-0b44-436d-874f-011b5ac39679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.049908 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb34d7-0b44-436d-874f-011b5ac39679 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.050544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb34d7-0b44-436d-874f-011b5ac39679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.052151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb34d7-0b44-436d-874f-011b5ac39679 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.056012 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f2235-257c-49b2-8c5e-dac35427e262 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.061314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.062078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.062362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.062638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] PATH_INFO: `/v3/projects/615f56f6b314481fa7f025aefb6a873c` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.063333 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1207/2428] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:19:57.063943 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=615f56f6b314481fa7f025aefb6a873c)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.066184 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.066991 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb34d7-0b44-436d-874f-011b5ac39679 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.076947 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb34d7-0b44-436d-874f-011b5ac39679 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.081578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a33df-242b-45c2-ab49-d16832ddb8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.082193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a33df-242b-45c2-ab49-d16832ddb8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.082479 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a33df-242b-45c2-ab49-d16832ddb8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.082751 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a33df-242b-45c2-ab49-d16832ddb8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.083393 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a33df-242b-45c2-ab49-d16832ddb8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.085019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a33df-242b-45c2-ab49-d16832ddb8e7 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.095384 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1208/2429] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:19:57.099659 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a33df-242b-45c2-ab49-d16832ddb8e7 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.110007 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a33df-242b-45c2-ab49-d16832ddb8e7 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.117149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615f56f6b314481fa7f025aefb6a873c', 'request_id': 'req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:57.123498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615f56f6b314481fa7f025aefb6a873c', 'request_id': 'req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:57.130146 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615f56f6b314481fa7f025aefb6a873c', 'request_id': 'req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:57.143373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] The token cache is being invalidate because project 615f56f6b314481fa7f025aefb6a873c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:57.143882 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:57.144566 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-e51fa9a1-d18b-40fd-9ce6-6e6abe5b0e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:57.146277 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1222/2430] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:56 2022] DELETE /identity/v3/projects/615f56f6b314481fa7f025aefb6a873c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:57.151332 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0523b-bc46-4998-adf4-d78cc158affb None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.151616 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0523b-bc46-4998-adf4-d78cc158affb None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.151885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0523b-bc46-4998-adf4-d78cc158affb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.169819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ca36c-5b40-4bb6-996f-7270c28c6909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.170507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ca36c-5b40-4bb6-996f-7270c28c6909 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.170780 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ca36c-5b40-4bb6-996f-7270c28c6909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.171048 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ca36c-5b40-4bb6-996f-7270c28c6909 admin admin] PATH_INFO: `/v3/projects/efb61fc3cdea496ab1855876c20f2b39/users/8c6e83f6bb8c442688e9520a1c858734/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.172188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-efe0523b-bc46-4998-adf4-d78cc158affb None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:57.173432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-efe0523b-bc46-4998-adf4-d78cc158affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:57.182068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1223/2431] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:57.187482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ca36c-5b40-4bb6-996f-7270c28c6909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb61fc3cdea496ab1855876c20f2b39, user_id=8c6e83f6bb8c442688e9520a1c858734, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.189910 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266f24b-844c-4517-a626-7fa2386aa7b9 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.190197 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266f24b-844c-4517-a626-7fa2386aa7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.190302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ca36c-5b40-4bb6-996f-7270c28c6909 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.190469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266f24b-844c-4517-a626-7fa2386aa7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.199217 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:57.204806 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1209/2432] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:57 2022] PUT /identity/v3/projects/efb61fc3cdea496ab1855876c20f2b39/users/8c6e83f6bb8c442688e9520a1c858734/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:57.210362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-a266f24b-844c-4517-a626-7fa2386aa7b9 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:57.211606 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a266f24b-844c-4517-a626-7fa2386aa7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:57.216286 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e563-0897-46be-9340-b87d6d2a0de5 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.216595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e563-0897-46be-9340-b87d6d2a0de5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.216871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e563-0897-46be-9340-b87d6d2a0de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.245555 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-6ad6e563-0897-46be-9340-b87d6d2a0de5 None None] MFA Rules not processed for user `8c6e83f6bb8c442688e9520a1c858734`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:57.247020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6ad6e563-0897-46be-9340-b87d6d2a0de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:57.274115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1224/2433] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:57.278420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266f24b-844c-4517-a626-7fa2386aa7b9 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.287108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266f24b-844c-4517-a626-7fa2386aa7b9 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.292594 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3989bd-9b59-48dd-89f1-0f4f8bdc9aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.293867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3989bd-9b59-48dd-89f1-0f4f8bdc9aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.294179 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3989bd-9b59-48dd-89f1-0f4f8bdc9aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.294508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3989bd-9b59-48dd-89f1-0f4f8bdc9aa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.295142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3989bd-9b59-48dd-89f1-0f4f8bdc9aa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:19:57.295445 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3989bd-9b59-48dd-89f1-0f4f8bdc9aa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.297208 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3989bd-9b59-48dd-89f1-0f4f8bdc9aa3 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.313702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1225/2434] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:19:57.313895 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1210/2435] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:19:57.314807 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3989bd-9b59-48dd-89f1-0f4f8bdc9aa3 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.315492 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e563-0897-46be-9340-b87d6d2a0de5 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.316828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6ad6e563-0897-46be-9340-b87d6d2a0de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:57.324893 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3989bd-9b59-48dd-89f1-0f4f8bdc9aa3 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.329766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407807ce-7aa1-41d3-9096-d207dbf54e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.329928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e563-0897-46be-9340-b87d6d2a0de5 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.330366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407807ce-7aa1-41d3-9096-d207dbf54e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.330638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407807ce-7aa1-41d3-9096-d207dbf54e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.330937 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407807ce-7aa1-41d3-9096-d207dbf54e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.331551 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407807ce-7aa1-41d3-9096-d207dbf54e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.333470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407807ce-7aa1-41d3-9096-d207dbf54e0e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.334421 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea832e-fff0-4b8c-8e63-643364a56bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.335017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea832e-fff0-4b8c-8e63-643364a56bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.335324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea832e-fff0-4b8c-8e63-643364a56bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.335597 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea832e-fff0-4b8c-8e63-643364a56bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.336221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea832e-fff0-4b8c-8e63-643364a56bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.338146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea832e-fff0-4b8c-8e63-643364a56bc9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.349881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:57.368431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1226/2436] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:57.368643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1211/2437] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:19:57.369668 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407807ce-7aa1-41d3-9096-d207dbf54e0e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.370358 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea832e-fff0-4b8c-8e63-643364a56bc9 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.429599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407807ce-7aa1-41d3-9096-d207dbf54e0e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.431553 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea832e-fff0-4b8c-8e63-643364a56bc9 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.434279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c4a50-a486-4720-8486-d24555f9632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.434887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c4a50-a486-4720-8486-d24555f9632c admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.435191 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c4a50-a486-4720-8486-d24555f9632c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.435456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c4a50-a486-4720-8486-d24555f9632c admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.436101 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c4a50-a486-4720-8486-d24555f9632c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.436230 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1d534-b31f-47b1-a1aa-dced64d33edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.436832 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1d534-b31f-47b1-a1aa-dced64d33edd admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.437110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1d534-b31f-47b1-a1aa-dced64d33edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.437374 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1d534-b31f-47b1-a1aa-dced64d33edd admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.437980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1d534-b31f-47b1-a1aa-dced64d33edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.438136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c4a50-a486-4720-8486-d24555f9632c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.439882 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1d534-b31f-47b1-a1aa-dced64d33edd admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.463284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1212/2438] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:57.467296 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1227/2439] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:57.467519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1d534-b31f-47b1-a1aa-dced64d33edd admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.471204 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c4a50-a486-4720-8486-d24555f9632c admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.477848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1d534-b31f-47b1-a1aa-dced64d33edd admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.481098 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c4a50-a486-4720-8486-d24555f9632c admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.483740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701c14-34cc-4bf0-8db1-da442820ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.484364 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701c14-34cc-4bf0-8db1-da442820ed34 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.484672 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701c14-34cc-4bf0-8db1-da442820ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.484953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701c14-34cc-4bf0-8db1-da442820ed34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.485610 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f701c14-34cc-4bf0-8db1-da442820ed34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.486163 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ad9ba-3f11-4455-909d-97a4ad8a6ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.486748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ad9ba-3f11-4455-909d-97a4ad8a6ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.487021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ad9ba-3f11-4455-909d-97a4ad8a6ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.487286 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ad9ba-3f11-4455-909d-97a4ad8a6ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.487382 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f701c14-34cc-4bf0-8db1-da442820ed34 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.487923 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ad9ba-3f11-4455-909d-97a4ad8a6ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.489532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ad9ba-3f11-4455-909d-97a4ad8a6ac6 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.500638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1213/2440] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:57.500804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1228/2441] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:57.503557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701c14-34cc-4bf0-8db1-da442820ed34 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.503690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ad9ba-3f11-4455-909d-97a4ad8a6ac6 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.513354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701c14-34cc-4bf0-8db1-da442820ed34 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.513556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ad9ba-3f11-4455-909d-97a4ad8a6ac6 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.518013 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4459a2-936b-4fe5-b896-1bef3603360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.518158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00309-3472-4003-bfa1-c72c30ba4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.518606 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4459a2-936b-4fe5-b896-1bef3603360b admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.518715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00309-3472-4003-bfa1-c72c30ba4009 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.518884 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4459a2-936b-4fe5-b896-1bef3603360b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.518989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00309-3472-4003-bfa1-c72c30ba4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.519156 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4459a2-936b-4fe5-b896-1bef3603360b admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.519259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00309-3472-4003-bfa1-c72c30ba4009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.519787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4459a2-936b-4fe5-b896-1bef3603360b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.519905 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d00309-3472-4003-bfa1-c72c30ba4009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.521404 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4459a2-936b-4fe5-b896-1bef3603360b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.521532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d00309-3472-4003-bfa1-c72c30ba4009 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.532095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1229/2442] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:57.535819 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1214/2443] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:57.536693 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00309-3472-4003-bfa1-c72c30ba4009 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.536835 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4459a2-936b-4fe5-b896-1bef3603360b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.546875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4459a2-936b-4fe5-b896-1bef3603360b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.547835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00309-3472-4003-bfa1-c72c30ba4009 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.552581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d83de-22b3-45d8-9aaa-c99092081870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.552828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6a394-8f95-4fea-8669-e527e4aa23dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.553270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d83de-22b3-45d8-9aaa-c99092081870 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.553465 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6a394-8f95-4fea-8669-e527e4aa23dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.553568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d83de-22b3-45d8-9aaa-c99092081870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.553746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6a394-8f95-4fea-8669-e527e4aa23dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.553857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d83de-22b3-45d8-9aaa-c99092081870 admin admin] PATH_INFO: `/v3/projects/b768679b5c3a4c2b8c48e406abf5d49e/users/04ba76ea8ba346b188698e30426d238c/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.553989 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6a394-8f95-4fea-8669-e527e4aa23dd admin admin] PATH_INFO: `/v3/projects/44fcaa034ca7474887541dba177b6740/users/ce6b4024576944a7a7d934f3703b74b3/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.568804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6a394-8f95-4fea-8669-e527e4aa23dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=44fcaa034ca7474887541dba177b6740, user_id=ce6b4024576944a7a7d934f3703b74b3, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.569347 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d83de-22b3-45d8-9aaa-c99092081870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b768679b5c3a4c2b8c48e406abf5d49e, user_id=04ba76ea8ba346b188698e30426d238c, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.571609 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6a394-8f95-4fea-8669-e527e4aa23dd admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.572068 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d83de-22b3-45d8-9aaa-c99092081870 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.586508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1230/2444] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:57 2022] PUT /identity/v3/projects/44fcaa034ca7474887541dba177b6740/users/ce6b4024576944a7a7d934f3703b74b3/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:57.587116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1215/2445] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:57 2022] PUT /identity/v3/projects/b768679b5c3a4c2b8c48e406abf5d49e/users/04ba76ea8ba346b188698e30426d238c/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:57.597151 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121516f-49ba-48bd-a182-68e118184e38 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.597466 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121516f-49ba-48bd-a182-68e118184e38 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.597740 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121516f-49ba-48bd-a182-68e118184e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.598225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69921f-5917-423e-b2eb-596ccdc743b6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.598571 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69921f-5917-423e-b2eb-596ccdc743b6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.598899 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69921f-5917-423e-b2eb-596ccdc743b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.619818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:57.627737 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-f121516f-49ba-48bd-a182-68e118184e38 None None] MFA Rules not processed for user `04ba76ea8ba346b188698e30426d238c`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:57.629038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f121516f-49ba-48bd-a182-68e118184e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:57.630097 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ce69921f-5917-423e-b2eb-596ccdc743b6 None None] MFA Rules not processed for user `ce6b4024576944a7a7d934f3703b74b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:57.632475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ce69921f-5917-423e-b2eb-596ccdc743b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:57.694480 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1216/2446] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:19:57.694780 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1231/2447] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:57.699118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69921f-5917-423e-b2eb-596ccdc743b6 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.699249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121516f-49ba-48bd-a182-68e118184e38 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.729757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:57.760846 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69921f-5917-423e-b2eb-596ccdc743b6 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.764030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121516f-49ba-48bd-a182-68e118184e38 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.765375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932cb78-32de-41ab-82fa-2d5e8116ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.766040 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932cb78-32de-41ab-82fa-2d5e8116ab4d admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.766314 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932cb78-32de-41ab-82fa-2d5e8116ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.766583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932cb78-32de-41ab-82fa-2d5e8116ab4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.767242 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932cb78-32de-41ab-82fa-2d5e8116ab4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.768695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a143-3779-4022-8bb6-a1811096c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.769216 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932cb78-32de-41ab-82fa-2d5e8116ab4d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.769319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a143-3779-4022-8bb6-a1811096c8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.769574 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a143-3779-4022-8bb6-a1811096c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.769844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a143-3779-4022-8bb6-a1811096c8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.770478 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3a143-3779-4022-8bb6-a1811096c8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.772396 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3a143-3779-4022-8bb6-a1811096c8e3 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.800562 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1217/2448] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:57.801107 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1232/2449] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:19:57.803565 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932cb78-32de-41ab-82fa-2d5e8116ab4d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.803723 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a143-3779-4022-8bb6-a1811096c8e3 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.868109 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a143-3779-4022-8bb6-a1811096c8e3 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.873329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345a873-cc38-4f08-9337-89c545fcb313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.873841 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932cb78-32de-41ab-82fa-2d5e8116ab4d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.873972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345a873-cc38-4f08-9337-89c545fcb313 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.874207 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345a873-cc38-4f08-9337-89c545fcb313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.874481 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345a873-cc38-4f08-9337-89c545fcb313 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.875119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345a873-cc38-4f08-9337-89c545fcb313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.877081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345a873-cc38-4f08-9337-89c545fcb313 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.878515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c169a-97ad-4ace-8f84-cddb37f11f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.879123 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c169a-97ad-4ace-8f84-cddb37f11f4d admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.879402 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c169a-97ad-4ace-8f84-cddb37f11f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.879675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c169a-97ad-4ace-8f84-cddb37f11f4d admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.880319 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c169a-97ad-4ace-8f84-cddb37f11f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.882291 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c169a-97ad-4ace-8f84-cddb37f11f4d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.900224 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1233/2450] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:19:57.906831 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1218/2451] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:19:57 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:19:57.906992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345a873-cc38-4f08-9337-89c545fcb313 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.907795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c169a-97ad-4ace-8f84-cddb37f11f4d admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.913587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345a873-cc38-4f08-9337-89c545fcb313 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.917157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c169a-97ad-4ace-8f84-cddb37f11f4d admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.918102 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447f692-e1e6-4670-b114-e3e4ca10fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.918692 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447f692-e1e6-4670-b114-e3e4ca10fc95 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.918965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447f692-e1e6-4670-b114-e3e4ca10fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.919236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447f692-e1e6-4670-b114-e3e4ca10fc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.919879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447f692-e1e6-4670-b114-e3e4ca10fc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.921533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447f692-e1e6-4670-b114-e3e4ca10fc95 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.922246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090885a-d75f-4337-9442-9e1be6197205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.922830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090885a-d75f-4337-9442-9e1be6197205 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.923109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090885a-d75f-4337-9442-9e1be6197205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.923387 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090885a-d75f-4337-9442-9e1be6197205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.924027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090885a-d75f-4337-9442-9e1be6197205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.925648 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090885a-d75f-4337-9442-9e1be6197205 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.934751 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1234/2452] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:19:57.938812 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447f692-e1e6-4670-b114-e3e4ca10fc95 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.938962 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1219/2453] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:19:57.939589 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090885a-d75f-4337-9442-9e1be6197205 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.945695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:57.945826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447f692-e1e6-4670-b114-e3e4ca10fc95 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.949381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090885a-d75f-4337-9442-9e1be6197205 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:57.950487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950b0ef-3ed1-4157-b251-3c1f7f302a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.951185 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950b0ef-3ed1-4157-b251-3c1f7f302a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.951517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950b0ef-3ed1-4157-b251-3c1f7f302a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.951818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950b0ef-3ed1-4157-b251-3c1f7f302a85 admin admin] PATH_INFO: `/v3/projects/e109a57f443448ef886fe1ef8032ce77/users/04f37caec70343039b89cc7a8c3d4b7d/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.955033 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ca103-33b0-4034-a697-8ecdf063e537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:57.955669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ca103-33b0-4034-a697-8ecdf063e537 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:57.955946 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ca103-33b0-4034-a697-8ecdf063e537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:57.956215 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ca103-33b0-4034-a697-8ecdf063e537 admin admin] PATH_INFO: `/v3/projects/5f6b692774b741968590fc2d6c9b71a9/users/706c4bf810814eb3b48303f7fa8fad13/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:57.967281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950b0ef-3ed1-4157-b251-3c1f7f302a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e109a57f443448ef886fe1ef8032ce77, user_id=04f37caec70343039b89cc7a8c3d4b7d, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.969980 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950b0ef-3ed1-4157-b251-3c1f7f302a85 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.972117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ca103-33b0-4034-a697-8ecdf063e537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6b692774b741968590fc2d6c9b71a9, user_id=706c4bf810814eb3b48303f7fa8fad13, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:57.974776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ca103-33b0-4034-a697-8ecdf063e537 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:57.984216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1235/2454] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:57 2022] PUT /identity/v3/projects/e109a57f443448ef886fe1ef8032ce77/users/04f37caec70343039b89cc7a8c3d4b7d/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:57.987861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950b0ef-3ed1-4157-b251-3c1f7f302a85 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:57.988395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1220/2455] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:57 2022] PUT /identity/v3/projects/5f6b692774b741968590fc2d6c9b71a9/users/706c4bf810814eb3b48303f7fa8fad13/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:57.991984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ca103-33b0-4034-a697-8ecdf063e537 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:58.050788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950b0ef-3ed1-4157-b251-3c1f7f302a85 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:58.054191 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ca103-33b0-4034-a697-8ecdf063e537 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:58.055378 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf7843-cdf4-460e-9492-585966c63576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:58.056049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7843-cdf4-460e-9492-585966c63576 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:58.056261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7843-cdf4-460e-9492-585966c63576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:58.056592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7843-cdf4-460e-9492-585966c63576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:58.057233 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf7843-cdf4-460e-9492-585966c63576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:58.058878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf7843-cdf4-460e-9492-585966c63576 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:58.059102 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85eeea-d088-45d6-ae51-0d73ab462f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:58.059827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85eeea-d088-45d6-ae51-0d73ab462f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:58.060131 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85eeea-d088-45d6-ae51-0d73ab462f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:58.060436 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85eeea-d088-45d6-ae51-0d73ab462f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:58.061100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85eeea-d088-45d6-ae51-0d73ab462f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:58.062718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85eeea-d088-45d6-ae51-0d73ab462f0a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:58.068785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1236/2456] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:19:58.072755 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1221/2457] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:19:58.073229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf7843-cdf4-460e-9492-585966c63576 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:58.076810 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85eeea-d088-45d6-ae51-0d73ab462f0a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:58.078375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:58.084636 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf7843-cdf4-460e-9492-585966c63576 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:58.087119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85eeea-d088-45d6-ae51-0d73ab462f0a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:58.089702 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6941a1-07e4-4868-a269-dc85b7cd3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:58.090362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6941a1-07e4-4868-a269-dc85b7cd3e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:58.090654 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6941a1-07e4-4868-a269-dc85b7cd3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:58.090957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6941a1-07e4-4868-a269-dc85b7cd3e53 admin admin] PATH_INFO: `/v3/projects/e109a57f443448ef886fe1ef8032ce77/users/04f37caec70343039b89cc7a8c3d4b7d/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:58.091636 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46074938-6bec-4d7b-8dac-536f6e19d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:58.092272 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46074938-6bec-4d7b-8dac-536f6e19d163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:58.092570 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46074938-6bec-4d7b-8dac-536f6e19d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:58.092839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46074938-6bec-4d7b-8dac-536f6e19d163 admin admin] PATH_INFO: `/v3/projects/5f6b692774b741968590fc2d6c9b71a9/users/706c4bf810814eb3b48303f7fa8fad13/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:58.092959 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6941a1-07e4-4868-a269-dc85b7cd3e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e109a57f443448ef886fe1ef8032ce77, user_id=04f37caec70343039b89cc7a8c3d4b7d, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:58.094731 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46074938-6bec-4d7b-8dac-536f6e19d163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6b692774b741968590fc2d6c9b71a9, user_id=706c4bf810814eb3b48303f7fa8fad13, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:58.095524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6941a1-07e4-4868-a269-dc85b7cd3e53 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:58.097430 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46074938-6bec-4d7b-8dac-536f6e19d163 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:58.106333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1237/2458] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:58 2022] PUT /identity/v3/projects/e109a57f443448ef886fe1ef8032ce77/users/04f37caec70343039b89cc7a8c3d4b7d/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:58.109067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1222/2459] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:19:58 2022] PUT /identity/v3/projects/5f6b692774b741968590fc2d6c9b71a9/users/706c4bf810814eb3b48303f7fa8fad13/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:58.116996 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f96e4a-d46f-4090-8784-1aa2bf33370d None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:58.117250 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f96e4a-d46f-4090-8784-1aa2bf33370d None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:58.117557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f96e4a-d46f-4090-8784-1aa2bf33370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:58.119049 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0592bb-9a3e-4fee-818b-1ad4804833ef None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:58.119330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0592bb-9a3e-4fee-818b-1ad4804833ef None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:58.119598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0592bb-9a3e-4fee-818b-1ad4804833ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:58.146596 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-55f96e4a-d46f-4090-8784-1aa2bf33370d None None] MFA Rules not processed for user `04f37caec70343039b89cc7a8c3d4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:58.146891 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3b0592bb-9a3e-4fee-818b-1ad4804833ef None None] MFA Rules not processed for user `706c4bf810814eb3b48303f7fa8fad13`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:58.147842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-55f96e4a-d46f-4090-8784-1aa2bf33370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:58.148136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3b0592bb-9a3e-4fee-818b-1ad4804833ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:58.216057 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1238/2460] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:19:58.221057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1223/2461] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:58.227539 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f96e4a-d46f-4090-8784-1aa2bf33370d None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:58.228557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0592bb-9a3e-4fee-818b-1ad4804833ef None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:58.228829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-55f96e4a-d46f-4090-8784-1aa2bf33370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:58.229895 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3b0592bb-9a3e-4fee-818b-1ad4804833ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:58.283476 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:58.286831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f96e4a-d46f-4090-8784-1aa2bf33370d None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:58.288245 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0592bb-9a3e-4fee-818b-1ad4804833ef None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:58.290928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082289e-a5ae-4f14-8e56-64ca3d6e961c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:58.291580 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082289e-a5ae-4f14-8e56-64ca3d6e961c service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:58.291857 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082289e-a5ae-4f14-8e56-64ca3d6e961c service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:58.292148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082289e-a5ae-4f14-8e56-64ca3d6e961c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:58.293417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca60882-49be-4258-aaaf-155922115dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:58.294031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca60882-49be-4258-aaaf-155922115dbe service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:58.294304 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca60882-49be-4258-aaaf-155922115dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:58.294630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca60882-49be-4258-aaaf-155922115dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:58.302275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082289e-a5ae-4f14-8e56-64ca3d6e961c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:58.303637 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082289e-a5ae-4f14-8e56-64ca3d6e961c service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:58.313652 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1239/2462] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:58.352127 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca60882-49be-4258-aaaf-155922115dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:58.353599 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca60882-49be-4258-aaaf-155922115dbe service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:58.363190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1224/2463] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:19:58.711037 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082289e-a5ae-4f14-8e56-64ca3d6e961c service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:58.771206 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082289e-a5ae-4f14-8e56-64ca3d6e961c service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:58.775984 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:58.776670 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:58.776943 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:58.777211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] PATH_INFO: `/v3/users/ce6b4024576944a7a7d934f3703b74b3` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:58.778331 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6b4024576944a7a7d934f3703b74b3)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:58.780251 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:58.800775 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:58.828969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6b4024576944a7a7d934f3703b74b3'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:58.835677 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6b4024576944a7a7d934f3703b74b3'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:58.836388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6b4024576944a7a7d934f3703b74b3'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:58.848879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6b4024576944a7a7d934f3703b74b3'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:58.849530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6b4024576944a7a7d934f3703b74b3'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:58.864828 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1240/2464] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:58 2022] DELETE /identity/v3/users/ce6b4024576944a7a7d934f3703b74b3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:58.869581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2fa8c-1e93-47ee-9a44-2e0fe7657c11 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:58.870080 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2fa8c-1e93-47ee-9a44-2e0fe7657c11 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:58.870177 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2fa8c-1e93-47ee-9a44-2e0fe7657c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:58.895243 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-38d2fa8c-1e93-47ee-9a44-2e0fe7657c11 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:19:58.896672 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-38d2fa8c-1e93-47ee-9a44-2e0fe7657c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:58.960759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1225/2465] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:19:58.970928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:58.972362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:59.049669 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662e110-fddd-4c58-b41b-706c2e54a390 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:59.053630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da367ec7-6543-47e4-9ddb-9af6cf5fa6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:59.054239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da367ec7-6543-47e4-9ddb-9af6cf5fa6eb service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:59.054513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da367ec7-6543-47e4-9ddb-9af6cf5fa6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:59.054782 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da367ec7-6543-47e4-9ddb-9af6cf5fa6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:59.064335 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da367ec7-6543-47e4-9ddb-9af6cf5fa6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:59.065773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da367ec7-6543-47e4-9ddb-9af6cf5fa6eb service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:59.075618 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1241/2466] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:59.343972 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2fa8c-1e93-47ee-9a44-2e0fe7657c11 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:59.345440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-38d2fa8c-1e93-47ee-9a44-2e0fe7657c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:59.363143 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2fa8c-1e93-47ee-9a44-2e0fe7657c11 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:59.367943 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:59.368630 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:59.368906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:59.369194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] PATH_INFO: `/v3/projects/44fcaa034ca7474887541dba177b6740` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:59.370483 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44fcaa034ca7474887541dba177b6740)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:59.372408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:59.421030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44fcaa034ca7474887541dba177b6740', 'request_id': 'req-5dd4a350-28b6-4dba-b710-944adf163ba7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:59.429764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44fcaa034ca7474887541dba177b6740', 'request_id': 'req-5dd4a350-28b6-4dba-b710-944adf163ba7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:59.436116 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44fcaa034ca7474887541dba177b6740', 'request_id': 'req-5dd4a350-28b6-4dba-b710-944adf163ba7'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:59.446458 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] The token cache is being invalidate because project 44fcaa034ca7474887541dba177b6740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:19:59.446740 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:59.447359 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:59.448886 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1226/2467] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:59 2022] DELETE /identity/v3/projects/44fcaa034ca7474887541dba177b6740 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:19:59.452933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da367ec7-6543-47e4-9ddb-9af6cf5fa6eb service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:59.462326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da367ec7-6543-47e4-9ddb-9af6cf5fa6eb service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:59.517816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:59.518527 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:59.518816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:59.519082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] PATH_INFO: `/v3/users/04f37caec70343039b89cc7a8c3d4b7d` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:59.520281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f37caec70343039b89cc7a8c3d4b7d)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:59.522230 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:19:59.568130 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:59.574753 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f37caec70343039b89cc7a8c3d4b7d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:59.583106 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f37caec70343039b89cc7a8c3d4b7d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:59.583783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f37caec70343039b89cc7a8c3d4b7d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:59.596371 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f37caec70343039b89cc7a8c3d4b7d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:59.596970 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f37caec70343039b89cc7a8c3d4b7d'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:19:59.612236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1242/2468] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:19:59 2022] DELETE /identity/v3/users/04f37caec70343039b89cc7a8c3d4b7d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:19:59.896466 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:59.897411 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:19:59.898818 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:59.898954 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:59.918169 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4a350-28b6-4dba-b710-944adf163ba7 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:59.948960 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:59.958695 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ca35b-c131-41eb-ad33-85892db8c432 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:19:59.962927 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd440753-c321-4353-b5d7-8e360107adff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:59.963540 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd440753-c321-4353-b5d7-8e360107adff service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:59.963818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd440753-c321-4353-b5d7-8e360107adff service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:59.964087 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd440753-c321-4353-b5d7-8e360107adff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:59.965915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-cd440753-c321-4353-b5d7-8e360107adff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:19:59.982733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:19:59.983741 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:19:59.984020 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:19:59.984306 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] PATH_INFO: `/v3/projects/e109a57f443448ef886fe1ef8032ce77` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:19:59.985429 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e109a57f443448ef886fe1ef8032ce77)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:19:59.987337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.024846 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd440753-c321-4353-b5d7-8e360107adff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.026292 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd440753-c321-4353-b5d7-8e360107adff service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.034520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e109a57f443448ef886fe1ef8032ce77', 'request_id': 'req-80eaa87e-8942-4e5a-a244-2507000e63f2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:00.035155 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1243/2469] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:19:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:00.043697 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e109a57f443448ef886fe1ef8032ce77', 'request_id': 'req-80eaa87e-8942-4e5a-a244-2507000e63f2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:00.050150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e109a57f443448ef886fe1ef8032ce77', 'request_id': 'req-80eaa87e-8942-4e5a-a244-2507000e63f2'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:00.060787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] The token cache is being invalidate because project e109a57f443448ef886fe1ef8032ce77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:00.061071 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:00.061828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-80eaa87e-8942-4e5a-a244-2507000e63f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:00.063326 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1227/2470] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:19:59 2022] DELETE /identity/v3/projects/e109a57f443448ef886fe1ef8032ce77 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:00.068474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb09ccf-fc55-4442-b05a-8a8da94ba8ac None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.068744 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb09ccf-fc55-4442-b05a-8a8da94ba8ac None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.069021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb09ccf-fc55-4442-b05a-8a8da94ba8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.090537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-3eb09ccf-fc55-4442-b05a-8a8da94ba8ac None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:00.091745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3eb09ccf-fc55-4442-b05a-8a8da94ba8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:00.152703 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1244/2471] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:00.160517 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be619f-6e35-4f72-8595-6ad635b15fe6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.161027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be619f-6e35-4f72-8595-6ad635b15fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.161305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be619f-6e35-4f72-8595-6ad635b15fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.182260 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-12be619f-6e35-4f72-8595-6ad635b15fe6 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:00.183481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-12be619f-6e35-4f72-8595-6ad635b15fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:00.191376 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1228/2472] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:00.195798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb09ccf-fc55-4442-b05a-8a8da94ba8ac None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.205941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb09ccf-fc55-4442-b05a-8a8da94ba8ac None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.212106 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941383b-e18b-4fd8-9ee3-761812ab702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.212926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941383b-e18b-4fd8-9ee3-761812ab702f admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.213298 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941383b-e18b-4fd8-9ee3-761812ab702f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.213507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941383b-e18b-4fd8-9ee3-761812ab702f admin admin] PATH_INFO: `/v3/domains` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.214285 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941383b-e18b-4fd8-9ee3-761812ab702f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:20:00.214494 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941383b-e18b-4fd8-9ee3-761812ab702f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.216283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941383b-e18b-4fd8-9ee3-761812ab702f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.225536 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:00.232326 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1245/2473] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:20:00.234302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be619f-6e35-4f72-8595-6ad635b15fe6 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.243638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be619f-6e35-4f72-8595-6ad635b15fe6 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.248257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd7285-080f-48a6-92e4-bcdf99a77f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.248893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd7285-080f-48a6-92e4-bcdf99a77f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.249166 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd7285-080f-48a6-92e4-bcdf99a77f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.249434 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd7285-080f-48a6-92e4-bcdf99a77f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.250076 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd7285-080f-48a6-92e4-bcdf99a77f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.252029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd7285-080f-48a6-92e4-bcdf99a77f64 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.280091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1229/2474] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:00 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:20:00.284631 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941383b-e18b-4fd8-9ee3-761812ab702f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.294705 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941383b-e18b-4fd8-9ee3-761812ab702f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.351271 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1d531-e1f1-4ac7-8086-21ef9855a87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.351912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1d531-e1f1-4ac7-8086-21ef9855a87c admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.352160 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1d531-e1f1-4ac7-8086-21ef9855a87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.352463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1d531-e1f1-4ac7-8086-21ef9855a87c admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.353091 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1d531-e1f1-4ac7-8086-21ef9855a87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.355035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1d531-e1f1-4ac7-8086-21ef9855a87c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.378153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1246/2475] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:00 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:00.382687 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd7285-080f-48a6-92e4-bcdf99a77f64 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.392856 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd7285-080f-48a6-92e4-bcdf99a77f64 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.397478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edad48-89d2-4328-b6c9-fd1db0f8f880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.398046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edad48-89d2-4328-b6c9-fd1db0f8f880 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.398321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edad48-89d2-4328-b6c9-fd1db0f8f880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.398593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edad48-89d2-4328-b6c9-fd1db0f8f880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.399244 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edad48-89d2-4328-b6c9-fd1db0f8f880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.400916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edad48-89d2-4328-b6c9-fd1db0f8f880 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.411581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1230/2476] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:00.415683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1d531-e1f1-4ac7-8086-21ef9855a87c admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.426188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1d531-e1f1-4ac7-8086-21ef9855a87c admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.431537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d63331-ca3e-4459-995f-e9f326749a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.432154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d63331-ca3e-4459-995f-e9f326749a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.432473 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d63331-ca3e-4459-995f-e9f326749a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.432746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d63331-ca3e-4459-995f-e9f326749a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.433421 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d63331-ca3e-4459-995f-e9f326749a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.435031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d63331-ca3e-4459-995f-e9f326749a8b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.448829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1247/2477] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:20:00.453002 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edad48-89d2-4328-b6c9-fd1db0f8f880 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.465489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edad48-89d2-4328-b6c9-fd1db0f8f880 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.470073 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95263edb-e15c-4345-96cc-24f494e9d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.470725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95263edb-e15c-4345-96cc-24f494e9d789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.470997 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95263edb-e15c-4345-96cc-24f494e9d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.471265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95263edb-e15c-4345-96cc-24f494e9d789 admin admin] PATH_INFO: `/v3/projects/bc7e9d2e88dd4adea5dc84bcc14b2b9f/users/09af60a0c6a64b6782767cf86eba21e0/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.486399 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95263edb-e15c-4345-96cc-24f494e9d789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7e9d2e88dd4adea5dc84bcc14b2b9f, user_id=09af60a0c6a64b6782767cf86eba21e0, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.489104 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95263edb-e15c-4345-96cc-24f494e9d789 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.505642 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1231/2478] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:00 2022] PUT /identity/v3/projects/bc7e9d2e88dd4adea5dc84bcc14b2b9f/users/09af60a0c6a64b6782767cf86eba21e0/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:00.517520 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decf790-c0a6-4b75-a27f-b15c21436317 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.518026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decf790-c0a6-4b75-a27f-b15c21436317 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.518205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decf790-c0a6-4b75-a27f-b15c21436317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.550678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-2decf790-c0a6-4b75-a27f-b15c21436317 None None] MFA Rules not processed for user `09af60a0c6a64b6782767cf86eba21e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:00.550678 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2decf790-c0a6-4b75-a27f-b15c21436317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:00.585233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95263edb-e15c-4345-96cc-24f494e9d789 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.587154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-95263edb-e15c-4345-96cc-24f494e9d789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:00.617476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1248/2479] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:00.622033 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decf790-c0a6-4b75-a27f-b15c21436317 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.648981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95263edb-e15c-4345-96cc-24f494e9d789 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.652730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd43a-5543-4a8e-be32-058ded11abcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.653363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd43a-5543-4a8e-be32-058ded11abcd service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.653638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd43a-5543-4a8e-be32-058ded11abcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.653905 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd43a-5543-4a8e-be32-058ded11abcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.656212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-97ffd43a-5543-4a8e-be32-058ded11abcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:00.662507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:00.687376 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decf790-c0a6-4b75-a27f-b15c21436317 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.692202 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0ff03-54fb-4820-b1eb-3637df295297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.692855 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ff03-54fb-4820-b1eb-3637df295297 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.693269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ff03-54fb-4820-b1eb-3637df295297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.693550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ff03-54fb-4820-b1eb-3637df295297 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.694221 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0ff03-54fb-4820-b1eb-3637df295297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.696324 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0ff03-54fb-4820-b1eb-3637df295297 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.711683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:00.726558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1249/2480] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:00 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:00.730388 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0ff03-54fb-4820-b1eb-3637df295297 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.735432 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffd43a-5543-4a8e-be32-058ded11abcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.736951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffd43a-5543-4a8e-be32-058ded11abcd service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.746754 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1232/2481] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:00.795928 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0ff03-54fb-4820-b1eb-3637df295297 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.801391 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e93c2d-55ed-4adb-bdfa-d94308836101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.802027 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93c2d-55ed-4adb-bdfa-d94308836101 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.802315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93c2d-55ed-4adb-bdfa-d94308836101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.802620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93c2d-55ed-4adb-bdfa-d94308836101 admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.803337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e93c2d-55ed-4adb-bdfa-d94308836101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.805516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e93c2d-55ed-4adb-bdfa-d94308836101 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.828748 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1250/2482] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:00 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:20:00.833265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd43a-5543-4a8e-be32-058ded11abcd service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.845199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd43a-5543-4a8e-be32-058ded11abcd service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.850603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410342a9-de73-49ee-b71c-5b1971a086c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.851214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410342a9-de73-49ee-b71c-5b1971a086c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.851493 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410342a9-de73-49ee-b71c-5b1971a086c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.851764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410342a9-de73-49ee-b71c-5b1971a086c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.852652 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410342a9-de73-49ee-b71c-5b1971a086c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.854355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410342a9-de73-49ee-b71c-5b1971a086c1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.866017 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1233/2483] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:20:00.870680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e93c2d-55ed-4adb-bdfa-d94308836101 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.881043 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e93c2d-55ed-4adb-bdfa-d94308836101 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.886519 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01591819-51e6-4103-992b-42a70ffb5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.887137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01591819-51e6-4103-992b-42a70ffb5ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.887409 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01591819-51e6-4103-992b-42a70ffb5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.887676 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01591819-51e6-4103-992b-42a70ffb5ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.888343 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01591819-51e6-4103-992b-42a70ffb5ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.889947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01591819-51e6-4103-992b-42a70ffb5ae8 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.900490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1251/2484] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:00.904814 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410342a9-de73-49ee-b71c-5b1971a086c1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:00.916327 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410342a9-de73-49ee-b71c-5b1971a086c1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:00.922376 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5dafc-8912-445d-9c32-33af414c554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:00.923219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5dafc-8912-445d-9c32-33af414c554b admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.923358 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5dafc-8912-445d-9c32-33af414c554b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.923573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5dafc-8912-445d-9c32-33af414c554b admin admin] PATH_INFO: `/v3/projects/9a0a4a2ef90a4a7898ee5e9ebc0f67a9/users/3e542e77fe0e48639bcfb7cdf566463b/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:00.939009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5dafc-8912-445d-9c32-33af414c554b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0a4a2ef90a4a7898ee5e9ebc0f67a9, user_id=3e542e77fe0e48639bcfb7cdf566463b, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:00.941826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5dafc-8912-445d-9c32-33af414c554b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:00.956765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1234/2485] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:00 2022] PUT /identity/v3/projects/9a0a4a2ef90a4a7898ee5e9ebc0f67a9/users/3e542e77fe0e48639bcfb7cdf566463b/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:00.969082 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ef317-bdfc-4cff-9ec0-b19de6b8118a None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:00.969358 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ef317-bdfc-4cff-9ec0-b19de6b8118a None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:00.969629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ef317-bdfc-4cff-9ec0-b19de6b8118a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.004712 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-133ef317-bdfc-4cff-9ec0-b19de6b8118a None None] MFA Rules not processed for user `3e542e77fe0e48639bcfb7cdf566463b`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:01.006393 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-133ef317-bdfc-4cff-9ec0-b19de6b8118a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:01.074366 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1252/2486] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:20:01.079122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5dafc-8912-445d-9c32-33af414c554b admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.142583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5dafc-8912-445d-9c32-33af414c554b admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.147710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517cde5-9ddb-4215-aad6-080ac24a47f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.148330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517cde5-9ddb-4215-aad6-080ac24a47f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.148625 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517cde5-9ddb-4215-aad6-080ac24a47f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.148900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517cde5-9ddb-4215-aad6-080ac24a47f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.149557 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517cde5-9ddb-4215-aad6-080ac24a47f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.151552 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517cde5-9ddb-4215-aad6-080ac24a47f5 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.180265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1235/2487] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:01 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:01.184036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ef317-bdfc-4cff-9ec0-b19de6b8118a None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.194709 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ef317-bdfc-4cff-9ec0-b19de6b8118a None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.253431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff207db-f80a-4c98-9254-5899e5b3dbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.254038 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff207db-f80a-4c98-9254-5899e5b3dbdd admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.254319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff207db-f80a-4c98-9254-5899e5b3dbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.254598 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff207db-f80a-4c98-9254-5899e5b3dbdd admin admin] PATH_INFO: `/v3/users` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.255239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff207db-f80a-4c98-9254-5899e5b3dbdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.257291 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff207db-f80a-4c98-9254-5899e5b3dbdd admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.266215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:01.280232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1253/2488] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:01 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:01.284274 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517cde5-9ddb-4215-aad6-080ac24a47f5 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.295339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517cde5-9ddb-4215-aad6-080ac24a47f5 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.300722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271317e7-a7f3-40e5-b052-e3d8e561fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.301324 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271317e7-a7f3-40e5-b052-e3d8e561fdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.301595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271317e7-a7f3-40e5-b052-e3d8e561fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.301863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271317e7-a7f3-40e5-b052-e3d8e561fdd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.302531 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271317e7-a7f3-40e5-b052-e3d8e561fdd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.304136 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271317e7-a7f3-40e5-b052-e3d8e561fdd1 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.315235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1236/2489] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:01.319328 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff207db-f80a-4c98-9254-5899e5b3dbdd admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.329952 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff207db-f80a-4c98-9254-5899e5b3dbdd admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.335921 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfae8f-8c69-49cf-bd9b-3d3294737590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.336613 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfae8f-8c69-49cf-bd9b-3d3294737590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.336895 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfae8f-8c69-49cf-bd9b-3d3294737590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.337168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfae8f-8c69-49cf-bd9b-3d3294737590 admin admin] PATH_INFO: `/v3/projects/34ae2b2e8dad4ef8b79ac349b884d416/users/e7c6647f9e6244bd8be5c92983e8b848/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.353433 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfae8f-8c69-49cf-bd9b-3d3294737590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ae2b2e8dad4ef8b79ac349b884d416, user_id=e7c6647f9e6244bd8be5c92983e8b848, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.356125 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfae8f-8c69-49cf-bd9b-3d3294737590 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.372066 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1254/2490] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:01 2022] PUT /identity/v3/projects/34ae2b2e8dad4ef8b79ac349b884d416/users/e7c6647f9e6244bd8be5c92983e8b848/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:01.376616 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271317e7-a7f3-40e5-b052-e3d8e561fdd1 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.392371 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271317e7-a7f3-40e5-b052-e3d8e561fdd1 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.440193 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:01.457961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfaed5-4537-4abd-a5ce-9c94d4a9868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.458561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfaed5-4537-4abd-a5ce-9c94d4a9868e admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.458837 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfaed5-4537-4abd-a5ce-9c94d4a9868e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.459107 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfaed5-4537-4abd-a5ce-9c94d4a9868e admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.459753 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cfaed5-4537-4abd-a5ce-9c94d4a9868e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.461472 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cfaed5-4537-4abd-a5ce-9c94d4a9868e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.471150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1237/2491] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:20:01.475671 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfae8f-8c69-49cf-bd9b-3d3294737590 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.486327 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfae8f-8c69-49cf-bd9b-3d3294737590 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.491284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a6dee-d77c-4a58-8b8b-9e3c226df71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.491976 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a6dee-d77c-4a58-8b8b-9e3c226df71b admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.492250 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a6dee-d77c-4a58-8b8b-9e3c226df71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.492549 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a6dee-d77c-4a58-8b8b-9e3c226df71b admin admin] PATH_INFO: `/v3/projects/34ae2b2e8dad4ef8b79ac349b884d416/users/e7c6647f9e6244bd8be5c92983e8b848/roles/67447f88528849c59df641acc7768c92` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.494448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a6dee-d77c-4a58-8b8b-9e3c226df71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ae2b2e8dad4ef8b79ac349b884d416, user_id=e7c6647f9e6244bd8be5c92983e8b848, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.497159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a6dee-d77c-4a58-8b8b-9e3c226df71b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.507144 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1255/2492] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:01 2022] PUT /identity/v3/projects/34ae2b2e8dad4ef8b79ac349b884d416/users/e7c6647f9e6244bd8be5c92983e8b848/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:01.517394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bae32-82ab-496a-821a-15bcb3fdcaba None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.517705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bae32-82ab-496a-821a-15bcb3fdcaba None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.517983 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bae32-82ab-496a-821a-15bcb3fdcaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.546853 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a81bae32-82ab-496a-821a-15bcb3fdcaba None None] MFA Rules not processed for user `e7c6647f9e6244bd8be5c92983e8b848`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:01.548063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a81bae32-82ab-496a-821a-15bcb3fdcaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:01.630901 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1238/2493] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:20:01.646829 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a6dee-d77c-4a58-8b8b-9e3c226df71b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:01.704649 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a6dee-d77c-4a58-8b8b-9e3c226df71b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:01.709055 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa419c-10be-4b5f-a961-9975ce9d205d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:01.709667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa419c-10be-4b5f-a961-9975ce9d205d service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:01.709947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa419c-10be-4b5f-a961-9975ce9d205d service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:01.710261 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa419c-10be-4b5f-a961-9975ce9d205d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:01.719563 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa419c-10be-4b5f-a961-9975ce9d205d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:01.721030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa419c-10be-4b5f-a961-9975ce9d205d service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:01.730915 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1256/2494] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:02.263834 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bae32-82ab-496a-821a-15bcb3fdcaba None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:02.277730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bae32-82ab-496a-821a-15bcb3fdcaba None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:02.282154 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cb087-28f1-4691-9b8d-1610841dcb46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:02.282759 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cb087-28f1-4691-9b8d-1610841dcb46 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:02.283036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cb087-28f1-4691-9b8d-1610841dcb46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:02.283305 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cb087-28f1-4691-9b8d-1610841dcb46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:02.341139 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cb087-28f1-4691-9b8d-1610841dcb46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:02.342647 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cb087-28f1-4691-9b8d-1610841dcb46 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:02.352173 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1239/2495] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:04.682019 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa419c-10be-4b5f-a961-9975ce9d205d service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.684256 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-adaa419c-10be-4b5f-a961-9975ce9d205d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:04.754557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa419c-10be-4b5f-a961-9975ce9d205d service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:04.760063 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:04.760749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.761026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.761294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] PATH_INFO: `/v3/users/8c6e83f6bb8c442688e9520a1c858734` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.762487 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6e83f6bb8c442688e9520a1c858734)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:04.764575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:04.814884 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6e83f6bb8c442688e9520a1c858734'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:04.821957 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6e83f6bb8c442688e9520a1c858734'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:04.822642 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6e83f6bb8c442688e9520a1c858734'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:04.824546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:04.836355 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6e83f6bb8c442688e9520a1c858734'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:04.836983 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6e83f6bb8c442688e9520a1c858734'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:04.850281 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1257/2496] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:04 2022] DELETE /identity/v3/users/8c6e83f6bb8c442688e9520a1c858734 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:04.855641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d576f8-aa67-4ae3-8ccb-44abd2484682 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:04.856117 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d576f8-aa67-4ae3-8ccb-44abd2484682 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:04.856235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d576f8-aa67-4ae3-8ccb-44abd2484682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:04.875955 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b8d576f8-aa67-4ae3-8ccb-44abd2484682 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:04.877120 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b8d576f8-aa67-4ae3-8ccb-44abd2484682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:04.941640 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1240/2497] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:20:04.951816 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:04.953237 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:05.011257 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae627-bb78-4dad-a102-11cb56019bec admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:05.016143 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d81c4-3f21-430a-92a7-cb292e0026b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:05.017513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d81c4-3f21-430a-92a7-cb292e0026b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:05.017804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d81c4-3f21-430a-92a7-cb292e0026b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:05.018081 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d81c4-3f21-430a-92a7-cb292e0026b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:05.029153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d81c4-3f21-430a-92a7-cb292e0026b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:05.030453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d81c4-3f21-430a-92a7-cb292e0026b1 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:05.040638 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1258/2498] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 13:20:05.311023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d576f8-aa67-4ae3-8ccb-44abd2484682 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:05.312548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b8d576f8-aa67-4ae3-8ccb-44abd2484682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:05.319682 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:05.325669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d576f8-aa67-4ae3-8ccb-44abd2484682 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:05.331417 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:05.332127 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:05.332443 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:05.332730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] PATH_INFO: `/v3/projects/efb61fc3cdea496ab1855876c20f2b39` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:05.333857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb61fc3cdea496ab1855876c20f2b39)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:05.335771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:05.390438 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb61fc3cdea496ab1855876c20f2b39', 'request_id': 'req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:05.398702 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb61fc3cdea496ab1855876c20f2b39', 'request_id': 'req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:05.405321 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb61fc3cdea496ab1855876c20f2b39', 'request_id': 'req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:05.416628 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] The token cache is being invalidate because project efb61fc3cdea496ab1855876c20f2b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:05.416889 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:05.417511 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:05.418979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1241/2499] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:05 2022] DELETE /identity/v3/projects/efb61fc3cdea496ab1855876c20f2b39 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:05.423150 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d81c4-3f21-430a-92a7-cb292e0026b1 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:05.433870 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d81c4-3f21-430a-92a7-cb292e0026b1 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:05.492904 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:05.493599 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:05.493879 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:05.494162 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] PATH_INFO: `/v3/users/04ba76ea8ba346b188698e30426d238c` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:05.495357 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ba76ea8ba346b188698e30426d238c)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:05.497333 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:05.554280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ba76ea8ba346b188698e30426d238c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:05.561112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ba76ea8ba346b188698e30426d238c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:05.561792 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ba76ea8ba346b188698e30426d238c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:05.574105 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ba76ea8ba346b188698e30426d238c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:05.574743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ba76ea8ba346b188698e30426d238c'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:05.583897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:05.589537 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1259/2500] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:05 2022] DELETE /identity/v3/users/04ba76ea8ba346b188698e30426d238c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:20:05.857492 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:05.859339 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:05.885368 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaba19-e1ad-4331-a85f-d00bbd8e3827 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:05.941284 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:05.941827 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:05.942098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:05.942363 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] PATH_INFO: `/v3/projects/b768679b5c3a4c2b8c48e406abf5d49e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:05.943482 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b768679b5c3a4c2b8c48e406abf5d49e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:05.945440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:05.992766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b768679b5c3a4c2b8c48e406abf5d49e', 'request_id': 'req-66ac03bd-5463-4392-91e6-3557f1ebe7b3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.000794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b768679b5c3a4c2b8c48e406abf5d49e', 'request_id': 'req-66ac03bd-5463-4392-91e6-3557f1ebe7b3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.006916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b768679b5c3a4c2b8c48e406abf5d49e', 'request_id': 'req-66ac03bd-5463-4392-91e6-3557f1ebe7b3'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.016910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] The token cache is being invalidate because project b768679b5c3a4c2b8c48e406abf5d49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:06.017190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.017797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.019277 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1242/2501] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:05 2022] DELETE /identity/v3/projects/b768679b5c3a4c2b8c48e406abf5d49e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:06.023419 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:06.024951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:06.037474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68752474-d5d3-4ecc-9417-38e68e057263 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:06.094149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:06.094770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:06.095045 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:06.095314 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] PATH_INFO: `/v3/users/706c4bf810814eb3b48303f7fa8fad13` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:06.096447 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=706c4bf810814eb3b48303f7fa8fad13)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:06.098360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:06.156268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '706c4bf810814eb3b48303f7fa8fad13'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.163390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '706c4bf810814eb3b48303f7fa8fad13'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.164086 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '706c4bf810814eb3b48303f7fa8fad13'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.176078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '706c4bf810814eb3b48303f7fa8fad13'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.176781 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '706c4bf810814eb3b48303f7fa8fad13'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.192429 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1260/2502] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:06 2022] DELETE /identity/v3/users/706c4bf810814eb3b48303f7fa8fad13 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:06.404698 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:06.406266 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:06.424863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:06.466787 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac03bd-5463-4392-91e6-3557f1ebe7b3 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:06.470279 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:06.472149 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:06.521870 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7e5c8-77a6-406a-8ea9-e196c9579222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:06.522490 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7e5c8-77a6-406a-8ea9-e196c9579222 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:06.522767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7e5c8-77a6-406a-8ea9-e196c9579222 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:06.523037 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7e5c8-77a6-406a-8ea9-e196c9579222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:06.525029 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1cd7e5c8-77a6-406a-8ea9-e196c9579222 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:06.550942 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca216583-93df-4da3-9016-7459e7561d4a admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:06.555454 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:06.556080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:06.556379 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:06.556651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] PATH_INFO: `/v3/projects/5f6b692774b741968590fc2d6c9b71a9` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:06.557770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6b692774b741968590fc2d6c9b71a9)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:06.559662 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:06.581448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:06.585223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7e5c8-77a6-406a-8ea9-e196c9579222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:06.586777 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7e5c8-77a6-406a-8ea9-e196c9579222 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:06.596219 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1243/2503] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:06.608363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6b692774b741968590fc2d6c9b71a9', 'request_id': 'req-d7e4e135-f2b8-4daf-b76a-631d089534f5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.614749 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6b692774b741968590fc2d6c9b71a9', 'request_id': 'req-d7e4e135-f2b8-4daf-b76a-631d089534f5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.621068 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6b692774b741968590fc2d6c9b71a9', 'request_id': 'req-d7e4e135-f2b8-4daf-b76a-631d089534f5'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.636941 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] The token cache is being invalidate because project 5f6b692774b741968590fc2d6c9b71a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:06.637322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.638028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-d7e4e135-f2b8-4daf-b76a-631d089534f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:06.653837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1261/2504] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:06 2022] DELETE /identity/v3/projects/5f6b692774b741968590fc2d6c9b71a9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:08.761956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7e5c8-77a6-406a-8ea9-e196c9579222 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:08.763664 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1cd7e5c8-77a6-406a-8ea9-e196c9579222 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:08.778508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7e5c8-77a6-406a-8ea9-e196c9579222 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:08.838400 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:08.839035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:08.839312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:08.839580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] PATH_INFO: `/v3/users/09af60a0c6a64b6782767cf86eba21e0` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:08.840926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09af60a0c6a64b6782767cf86eba21e0)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:08.842920 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:08.876381 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:08.896595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09af60a0c6a64b6782767cf86eba21e0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:08.903325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09af60a0c6a64b6782767cf86eba21e0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:08.914854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09af60a0c6a64b6782767cf86eba21e0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:08.915508 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09af60a0c6a64b6782767cf86eba21e0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:08.916145 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09af60a0c6a64b6782767cf86eba21e0'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:08.930442 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1244/2505] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:08 2022] DELETE /identity/v3/users/09af60a0c6a64b6782767cf86eba21e0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:08.935239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3cf98-6482-4347-a38a-559b3d702494 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:08.935716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3cf98-6482-4347-a38a-559b3d702494 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:08.935813 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3cf98-6482-4347-a38a-559b3d702494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:08.955301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c2b3cf98-6482-4347-a38a-559b3d702494 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:08.956605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c2b3cf98-6482-4347-a38a-559b3d702494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:09.025593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1262/2506] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:20:09.035786 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:09.037277 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:09.098546 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4e446-36c4-4af6-83ed-ac4786d701e5 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:09.102765 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a79408-a780-4ea7-bf26-efbf684c220d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:09.103373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79408-a780-4ea7-bf26-efbf684c220d service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:09.103646 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79408-a780-4ea7-bf26-efbf684c220d service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:09.103917 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79408-a780-4ea7-bf26-efbf684c220d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:09.114008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a79408-a780-4ea7-bf26-efbf684c220d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:09.115439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a79408-a780-4ea7-bf26-efbf684c220d service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:09.125035 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1245/2507] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:09.393890 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3cf98-6482-4347-a38a-559b3d702494 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:09.395438 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c2b3cf98-6482-4347-a38a-559b3d702494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:09.408617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3cf98-6482-4347-a38a-559b3d702494 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:09.418482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:09.419305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:09.419499 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:09.419747 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] PATH_INFO: `/v3/projects/bc7e9d2e88dd4adea5dc84bcc14b2b9f` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:09.420998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7e9d2e88dd4adea5dc84bcc14b2b9f)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:09.422880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:09.471080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7e9d2e88dd4adea5dc84bcc14b2b9f', 'request_id': 'req-147367af-e7fe-4378-b910-1ee108f9e464'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:09.477167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7e9d2e88dd4adea5dc84bcc14b2b9f', 'request_id': 'req-147367af-e7fe-4378-b910-1ee108f9e464'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:09.483738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7e9d2e88dd4adea5dc84bcc14b2b9f', 'request_id': 'req-147367af-e7fe-4378-b910-1ee108f9e464'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:09.497132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] The token cache is being invalidate because project bc7e9d2e88dd4adea5dc84bcc14b2b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:09.497415 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:09.498021 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:09.499507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1263/2508] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:09 2022] DELETE /identity/v3/projects/bc7e9d2e88dd4adea5dc84bcc14b2b9f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:09.503710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a79408-a780-4ea7-bf26-efbf684c220d service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:09.513761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a79408-a780-4ea7-bf26-efbf684c220d service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:09.573318 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:09.573872 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:09.574153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:09.574424 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] PATH_INFO: `/v3/users/3e542e77fe0e48639bcfb7cdf566463b` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:09.575593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e542e77fe0e48639bcfb7cdf566463b)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:09.577573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:09.628543 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e542e77fe0e48639bcfb7cdf566463b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:09.630737 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:09.636743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e542e77fe0e48639bcfb7cdf566463b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:09.649963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e542e77fe0e48639bcfb7cdf566463b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:09.650757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e542e77fe0e48639bcfb7cdf566463b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:09.651409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e542e77fe0e48639bcfb7cdf566463b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:09.666187 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1246/2509] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:09 2022] DELETE /identity/v3/users/3e542e77fe0e48639bcfb7cdf566463b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:09.951582 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:09.953835 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:09.970711 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147367af-e7fe-4378-b910-1ee108f9e464 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:10.005174 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:10.038587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:10.039242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.039506 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.039777 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] PATH_INFO: `/v3/projects/9a0a4a2ef90a4a7898ee5e9ebc0f67a9` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.041122 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0a4a2ef90a4a7898ee5e9ebc0f67a9)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:10.043046 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:10.093443 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0a4a2ef90a4a7898ee5e9ebc0f67a9', 'request_id': 'req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.099153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0a4a2ef90a4a7898ee5e9ebc0f67a9', 'request_id': 'req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.105507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0a4a2ef90a4a7898ee5e9ebc0f67a9', 'request_id': 'req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.120904 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] The token cache is being invalidate because project 9a0a4a2ef90a4a7898ee5e9ebc0f67a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:10.121167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.121851 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.123439 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1264/2510] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:09 2022] DELETE /identity/v3/projects/9a0a4a2ef90a4a7898ee5e9ebc0f67a9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:10.127627 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:10.129203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:10.142673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e06349-1ef5-44eb-8043-8ec1be3c652e admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:10.202958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:10.203669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.203979 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.204528 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] PATH_INFO: `/v3/users/e7c6647f9e6244bd8be5c92983e8b848` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.205893 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c6647f9e6244bd8be5c92983e8b848)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:10.208066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:10.262409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c6647f9e6244bd8be5c92983e8b848'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.269918 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c6647f9e6244bd8be5c92983e8b848'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.282705 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c6647f9e6244bd8be5c92983e8b848'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.283481 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c6647f9e6244bd8be5c92983e8b848'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.284192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8dbc7c40-2d52-4afb-8bf0-3772fd051ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c6647f9e6244bd8be5c92983e8b848'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.298981 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1247/2511] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:10 2022] DELETE /identity/v3/users/e7c6647f9e6244bd8be5c92983e8b848 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:10.580051 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:10.581645 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:10.596876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bea0d-d1bc-4de2-8957-75aa52c4e88e admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:10.657679 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:10.658319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.658600 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.658880 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] PATH_INFO: `/v3/projects/34ae2b2e8dad4ef8b79ac349b884d416` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.660056 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ae2b2e8dad4ef8b79ac349b884d416)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:10.662034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:10.719351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ae2b2e8dad4ef8b79ac349b884d416', 'request_id': 'req-9ca6fec3-b42b-460d-b1b1-da641525c775'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.725313 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ae2b2e8dad4ef8b79ac349b884d416', 'request_id': 'req-9ca6fec3-b42b-460d-b1b1-da641525c775'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.731524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ae2b2e8dad4ef8b79ac349b884d416', 'request_id': 'req-9ca6fec3-b42b-460d-b1b1-da641525c775'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.733574 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:10.747213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] The token cache is being invalidate because project 34ae2b2e8dad4ef8b79ac349b884d416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:10.747817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.748544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-9ca6fec3-b42b-460d-b1b1-da641525c775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:10.750139 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1265/2512] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:10 2022] DELETE /identity/v3/projects/34ae2b2e8dad4ef8b79ac349b884d416 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:10.756182 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c47ec-19e9-41ba-a10c-7b2dd995c39e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.756516 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c47ec-19e9-41ba-a10c-7b2dd995c39e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.756795 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c47ec-19e9-41ba-a10c-7b2dd995c39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.778360 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3e4c47ec-19e9-41ba-a10c-7b2dd995c39e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:10.779941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3e4c47ec-19e9-41ba-a10c-7b2dd995c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:10.822914 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:10.842141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1248/2513] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:10.850742 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91799461-7e1d-4109-a5a0-fbd31ed0ec40 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.851095 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91799461-7e1d-4109-a5a0-fbd31ed0ec40 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.851435 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91799461-7e1d-4109-a5a0-fbd31ed0ec40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.872934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-91799461-7e1d-4109-a5a0-fbd31ed0ec40 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:10.874137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-91799461-7e1d-4109-a5a0-fbd31ed0ec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:10.883411 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1266/2514] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:10.888074 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c47ec-19e9-41ba-a10c-7b2dd995c39e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:10.897939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c47ec-19e9-41ba-a10c-7b2dd995c39e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:10.902992 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2c14b-b9ca-4bb1-b0c9-e928dbd209a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:10.903581 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2c14b-b9ca-4bb1-b0c9-e928dbd209a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.903855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2c14b-b9ca-4bb1-b0c9-e928dbd209a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.904124 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2c14b-b9ca-4bb1-b0c9-e928dbd209a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.904800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2c14b-b9ca-4bb1-b0c9-e928dbd209a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:20:10.905098 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2c14b-b9ca-4bb1-b0c9-e928dbd209a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:10.906694 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2c14b-b9ca-4bb1-b0c9-e928dbd209a5 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:10.919012 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1249/2515] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 13:20:10.923418 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91799461-7e1d-4109-a5a0-fbd31ed0ec40 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:10.933048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91799461-7e1d-4109-a5a0-fbd31ed0ec40 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:10.938834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018525d-3365-4e93-a60d-ebe7d8631608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:10.939482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018525d-3365-4e93-a60d-ebe7d8631608 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:10.939752 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018525d-3365-4e93-a60d-ebe7d8631608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:10.940020 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018525d-3365-4e93-a60d-ebe7d8631608 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:10.940685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018525d-3365-4e93-a60d-ebe7d8631608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:10.942571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018525d-3365-4e93-a60d-ebe7d8631608 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:10.972083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1267/2516] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:10 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:10.976003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2c14b-b9ca-4bb1-b0c9-e928dbd209a5 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:10.987595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2c14b-b9ca-4bb1-b0c9-e928dbd209a5 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.046903 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eea9b-94c9-4395-8a54-87a0e7be1090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.047515 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eea9b-94c9-4395-8a54-87a0e7be1090 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.047792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eea9b-94c9-4395-8a54-87a0e7be1090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.048063 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eea9b-94c9-4395-8a54-87a0e7be1090 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.048748 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01eea9b-94c9-4395-8a54-87a0e7be1090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.050700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01eea9b-94c9-4395-8a54-87a0e7be1090 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.076951 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1250/2517] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:10 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:20:11.082867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018525d-3365-4e93-a60d-ebe7d8631608 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.093448 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018525d-3365-4e93-a60d-ebe7d8631608 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.098360 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d237ac8-af34-423d-be44-a262b4e5359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.098956 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d237ac8-af34-423d-be44-a262b4e5359c admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.099232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d237ac8-af34-423d-be44-a262b4e5359c admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.099498 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d237ac8-af34-423d-be44-a262b4e5359c admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.100133 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d237ac8-af34-423d-be44-a262b4e5359c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.101778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d237ac8-af34-423d-be44-a262b4e5359c admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.112002 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1268/2518] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:11.116066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eea9b-94c9-4395-8a54-87a0e7be1090 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.126667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eea9b-94c9-4395-8a54-87a0e7be1090 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.132221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686d545-a82a-4aa5-a7ab-339c33378a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.132857 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686d545-a82a-4aa5-a7ab-339c33378a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.133135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686d545-a82a-4aa5-a7ab-339c33378a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.133410 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686d545-a82a-4aa5-a7ab-339c33378a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.134061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686d545-a82a-4aa5-a7ab-339c33378a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.135673 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686d545-a82a-4aa5-a7ab-339c33378a46 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.146925 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1251/2519] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 13:20:11.151199 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d237ac8-af34-423d-be44-a262b4e5359c admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.161837 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d237ac8-af34-423d-be44-a262b4e5359c admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.167854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469ad74-5de2-42b6-b684-417e9b88be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.168710 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469ad74-5de2-42b6-b684-417e9b88be1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.168991 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469ad74-5de2-42b6-b684-417e9b88be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.169319 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469ad74-5de2-42b6-b684-417e9b88be1d admin admin] PATH_INFO: `/v3/projects/2a912d8bf81b459cba7a6e01a33daf83/users/5e18b1c8cb9c4f59a8dc146430ed2d1c/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.184732 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469ad74-5de2-42b6-b684-417e9b88be1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a912d8bf81b459cba7a6e01a33daf83, user_id=5e18b1c8cb9c4f59a8dc146430ed2d1c, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.187425 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469ad74-5de2-42b6-b684-417e9b88be1d admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.202641 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1269/2520] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:11 2022] PUT /identity/v3/projects/2a912d8bf81b459cba7a6e01a33daf83/users/5e18b1c8cb9c4f59a8dc146430ed2d1c/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:11.214100 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb5116-f97b-4dee-b8ad-eab83c123b1f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.214394 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb5116-f97b-4dee-b8ad-eab83c123b1f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.214669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb5116-f97b-4dee-b8ad-eab83c123b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.244519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c1fb5116-f97b-4dee-b8ad-eab83c123b1f None None] MFA Rules not processed for user `5e18b1c8cb9c4f59a8dc146430ed2d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:11.245761 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c1fb5116-f97b-4dee-b8ad-eab83c123b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:11.312712 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1252/2521] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:11.317423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469ad74-5de2-42b6-b684-417e9b88be1d admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.381770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469ad74-5de2-42b6-b684-417e9b88be1d admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.388694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a7ce0-a1c0-4fd4-875b-f3cb34307321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.389301 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a7ce0-a1c0-4fd4-875b-f3cb34307321 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.389584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a7ce0-a1c0-4fd4-875b-f3cb34307321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.389861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a7ce0-a1c0-4fd4-875b-f3cb34307321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.390497 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a7ce0-a1c0-4fd4-875b-f3cb34307321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.392456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a7ce0-a1c0-4fd4-875b-f3cb34307321 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.424790 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1270/2522] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:11 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:11.429435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb5116-f97b-4dee-b8ad-eab83c123b1f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.441135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb5116-f97b-4dee-b8ad-eab83c123b1f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.482572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:11.500942 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5602a83-9867-45aa-8c4d-c5213e8f331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.501548 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5602a83-9867-45aa-8c4d-c5213e8f331e admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.501826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5602a83-9867-45aa-8c4d-c5213e8f331e admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.502096 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5602a83-9867-45aa-8c4d-c5213e8f331e admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.502721 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5602a83-9867-45aa-8c4d-c5213e8f331e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.504710 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5602a83-9867-45aa-8c4d-c5213e8f331e admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.527030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1253/2523] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:11 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:11.531364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a7ce0-a1c0-4fd4-875b-f3cb34307321 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.541836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a7ce0-a1c0-4fd4-875b-f3cb34307321 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.546656 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3ffd5-18f9-4ca3-bc91-6fc6bc622d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.547259 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3ffd5-18f9-4ca3-bc91-6fc6bc622d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.547544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3ffd5-18f9-4ca3-bc91-6fc6bc622d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.547818 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3ffd5-18f9-4ca3-bc91-6fc6bc622d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.548517 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3ffd5-18f9-4ca3-bc91-6fc6bc622d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.550120 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3ffd5-18f9-4ca3-bc91-6fc6bc622d8b admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.560666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1271/2524] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:11.564792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5602a83-9867-45aa-8c4d-c5213e8f331e admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.575406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5602a83-9867-45aa-8c4d-c5213e8f331e admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.581043 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74e21-98fd-4bb4-a4ad-6ba88b0ef0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.581704 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74e21-98fd-4bb4-a4ad-6ba88b0ef0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.582046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74e21-98fd-4bb4-a4ad-6ba88b0ef0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.582199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd74e21-98fd-4bb4-a4ad-6ba88b0ef0c3 admin admin] PATH_INFO: `/v3/projects/2098ba81c3c54ded8cb24a5fbaaed36d/users/ef00d9c6431d44888f12b17d9d2ef61c/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.598282 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd74e21-98fd-4bb4-a4ad-6ba88b0ef0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2098ba81c3c54ded8cb24a5fbaaed36d, user_id=ef00d9c6431d44888f12b17d9d2ef61c, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.601016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd74e21-98fd-4bb4-a4ad-6ba88b0ef0c3 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.615684 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1254/2525] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:11 2022] PUT /identity/v3/projects/2098ba81c3c54ded8cb24a5fbaaed36d/users/ef00d9c6431d44888f12b17d9d2ef61c/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 13:20:11.620097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3ffd5-18f9-4ca3-bc91-6fc6bc622d8b admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.632225 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3ffd5-18f9-4ca3-bc91-6fc6bc622d8b admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.693584 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b14fa2-0413-4f89-b5fa-b113d7a195a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.694114 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b14fa2-0413-4f89-b5fa-b113d7a195a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.694392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b14fa2-0413-4f89-b5fa-b113d7a195a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.694663 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b14fa2-0413-4f89-b5fa-b113d7a195a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.695309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b14fa2-0413-4f89-b5fa-b113d7a195a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.697039 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b14fa2-0413-4f89-b5fa-b113d7a195a6 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.699035 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:11.707840 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1272/2526] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:11.711862 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74e21-98fd-4bb4-a4ad-6ba88b0ef0c3 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.722128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd74e21-98fd-4bb4-a4ad-6ba88b0ef0c3 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.726794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61afef-e53e-4765-8857-8d66def6f59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.727447 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61afef-e53e-4765-8857-8d66def6f59c admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.727724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61afef-e53e-4765-8857-8d66def6f59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.727993 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61afef-e53e-4765-8857-8d66def6f59c admin admin] PATH_INFO: `/v3/projects/2098ba81c3c54ded8cb24a5fbaaed36d/users/ef00d9c6431d44888f12b17d9d2ef61c/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.730008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61afef-e53e-4765-8857-8d66def6f59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2098ba81c3c54ded8cb24a5fbaaed36d, user_id=ef00d9c6431d44888f12b17d9d2ef61c, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.733036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61afef-e53e-4765-8857-8d66def6f59c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.744057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1255/2527] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:11 2022] PUT /identity/v3/projects/2098ba81c3c54ded8cb24a5fbaaed36d/users/ef00d9c6431d44888f12b17d9d2ef61c/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:11.755152 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb6f4-f6ae-4ff4-bd19-6a3ba861da30 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.755671 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb6f4-f6ae-4ff4-bd19-6a3ba861da30 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.755951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb6f4-f6ae-4ff4-bd19-6a3ba861da30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.791523 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-c62fb6f4-f6ae-4ff4-bd19-6a3ba861da30 None None] MFA Rules not processed for user `ef00d9c6431d44888f12b17d9d2ef61c`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:11.792817 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-c62fb6f4-f6ae-4ff4-bd19-6a3ba861da30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:11.863153 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1273/2528] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:11.874793 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61afef-e53e-4765-8857-8d66def6f59c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:11.876906 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9d61afef-e53e-4765-8857-8d66def6f59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:11.938762 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61afef-e53e-4765-8857-8d66def6f59c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:11.943026 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144dc24-eda6-41d5-b500-af41c9045240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:11.943690 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144dc24-eda6-41d5-b500-af41c9045240 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:11.943860 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144dc24-eda6-41d5-b500-af41c9045240 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:11.944149 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144dc24-eda6-41d5-b500-af41c9045240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:11.953735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144dc24-eda6-41d5-b500-af41c9045240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:11.955163 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144dc24-eda6-41d5-b500-af41c9045240 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:11.964809 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1256/2529] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:12.071203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fb6f4-f6ae-4ff4-bd19-6a3ba861da30 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:12.082247 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fb6f4-f6ae-4ff4-bd19-6a3ba861da30 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:12.086559 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e2ba-d1a3-4eb2-91e0-7496f6bd2ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:12.087182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e2ba-d1a3-4eb2-91e0-7496f6bd2ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:12.087477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e2ba-d1a3-4eb2-91e0-7496f6bd2ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:12.087833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e2ba-d1a3-4eb2-91e0-7496f6bd2ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:12.145296 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82e2ba-d1a3-4eb2-91e0-7496f6bd2ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:12.146733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82e2ba-d1a3-4eb2-91e0-7496f6bd2ab7 service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:12.155546 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1274/2530] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:14.773996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144dc24-eda6-41d5-b500-af41c9045240 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:14.839713 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144dc24-eda6-41d5-b500-af41c9045240 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:14.844649 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:14.845279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:14.845554 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:14.845820 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] PATH_INFO: `/v3/users/5e18b1c8cb9c4f59a8dc146430ed2d1c` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:14.847038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e18b1c8cb9c4f59a8dc146430ed2d1c)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:14.849005 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:14.893467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:14.900924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e18b1c8cb9c4f59a8dc146430ed2d1c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:14.907957 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e18b1c8cb9c4f59a8dc146430ed2d1c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:14.919958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e18b1c8cb9c4f59a8dc146430ed2d1c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:14.920651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e18b1c8cb9c4f59a8dc146430ed2d1c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:14.921299 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e18b1c8cb9c4f59a8dc146430ed2d1c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:14.935520 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1257/2531] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:14 2022] DELETE /identity/v3/users/5e18b1c8cb9c4f59a8dc146430ed2d1c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:14.940180 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e7e74-a24d-41dd-bfcc-c40deabf2796 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:14.940674 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e7e74-a24d-41dd-bfcc-c40deabf2796 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:14.940861 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e7e74-a24d-41dd-bfcc-c40deabf2796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:14.960072 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-5f6e7e74-a24d-41dd-bfcc-c40deabf2796 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:14.961323 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5f6e7e74-a24d-41dd-bfcc-c40deabf2796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:15.027290 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1275/2532] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:20:15.037325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:15.038909 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:15.110119 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e505335-ddce-4240-89ab-8fb0818ef02f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:15.113792 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da9f1b-61dd-4ffc-b9e5-fc2d2abc2b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:15.114405 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da9f1b-61dd-4ffc-b9e5-fc2d2abc2b49 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:15.114680 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da9f1b-61dd-4ffc-b9e5-fc2d2abc2b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:15.114945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da9f1b-61dd-4ffc-b9e5-fc2d2abc2b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:15.124273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da9f1b-61dd-4ffc-b9e5-fc2d2abc2b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:15.125738 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da9f1b-61dd-4ffc-b9e5-fc2d2abc2b49 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:15.135302 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1258/2533] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:15.423672 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e7e74-a24d-41dd-bfcc-c40deabf2796 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:15.425193 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5f6e7e74-a24d-41dd-bfcc-c40deabf2796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:15.438671 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e7e74-a24d-41dd-bfcc-c40deabf2796 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:15.443944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:15.444625 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:15.444894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:15.445167 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] PATH_INFO: `/v3/projects/2a912d8bf81b459cba7a6e01a33daf83` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:15.446316 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a912d8bf81b459cba7a6e01a33daf83)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:15.448639 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:15.466514 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=100 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:15.499542 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a912d8bf81b459cba7a6e01a33daf83', 'request_id': 'req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:15.505239 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a912d8bf81b459cba7a6e01a33daf83', 'request_id': 'req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:15.511761 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a912d8bf81b459cba7a6e01a33daf83', 'request_id': 'req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:15.526255 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] The token cache is being invalidate because project 2a912d8bf81b459cba7a6e01a33daf83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:15.526556 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:15.527145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:15.528653 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1276/2534] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:15 2022] DELETE /identity/v3/projects/2a912d8bf81b459cba7a6e01a33daf83 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:15.533135 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da9f1b-61dd-4ffc-b9e5-fc2d2abc2b49 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:15.542939 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da9f1b-61dd-4ffc-b9e5-fc2d2abc2b49 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:15.613289 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:15.613928 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:15.614199 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:15.614468 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] PATH_INFO: `/v3/users/ef00d9c6431d44888f12b17d9d2ef61c` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:15.615607 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef00d9c6431d44888f12b17d9d2ef61c)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:15.617638 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:15.666113 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef00d9c6431d44888f12b17d9d2ef61c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:15.673046 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef00d9c6431d44888f12b17d9d2ef61c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:15.677496 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:15.686797 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef00d9c6431d44888f12b17d9d2ef61c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:15.687568 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef00d9c6431d44888f12b17d9d2ef61c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:15.688189 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-f9869999-0571-47b0-bcc3-7b0a18ffb31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef00d9c6431d44888f12b17d9d2ef61c'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:15.701452 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1259/2535] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:15 2022] DELETE /identity/v3/users/ef00d9c6431d44888f12b17d9d2ef61c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:15.989953 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:15.991576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:16.005168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3abb0-a9bb-4c24-aacd-d19f60cf59b7 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:16.061685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:16.062231 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.062508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.062788 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] PATH_INFO: `/v3/projects/2098ba81c3c54ded8cb24a5fbaaed36d` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.063888 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2098ba81c3c54ded8cb24a5fbaaed36d)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:16.065910 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:16.118182 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2098ba81c3c54ded8cb24a5fbaaed36d', 'request_id': 'req-4434dcdb-d060-4406-aa58-518c170d8beb'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:16.124048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2098ba81c3c54ded8cb24a5fbaaed36d', 'request_id': 'req-4434dcdb-d060-4406-aa58-518c170d8beb'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:16.130453 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2098ba81c3c54ded8cb24a5fbaaed36d', 'request_id': 'req-4434dcdb-d060-4406-aa58-518c170d8beb'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:16.144852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] The token cache is being invalidate because project 2098ba81c3c54ded8cb24a5fbaaed36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:16.145134 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:16.145736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-4434dcdb-d060-4406-aa58-518c170d8beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:16.147254 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1277/2536] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:15 2022] DELETE /identity/v3/projects/2098ba81c3c54ded8cb24a5fbaaed36d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:16.152439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22267e34-b73d-4857-b327-460dc17ab98b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.152954 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22267e34-b73d-4857-b327-460dc17ab98b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.153216 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22267e34-b73d-4857-b327-460dc17ab98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.175403 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-22267e34-b73d-4857-b327-460dc17ab98b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:16.176654 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-22267e34-b73d-4857-b327-460dc17ab98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:16.236822 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1260/2537] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:16.244826 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872a78-1bb7-4533-a11b-2da909b5325e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.245205 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872a78-1bb7-4533-a11b-2da909b5325e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.245495 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872a78-1bb7-4533-a11b-2da909b5325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.266351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-2c872a78-1bb7-4533-a11b-2da909b5325e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:16.267570 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-2c872a78-1bb7-4533-a11b-2da909b5325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:16.276655 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1278/2538] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:16.281027 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22267e34-b73d-4857-b327-460dc17ab98b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:16.291264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22267e34-b73d-4857-b327-460dc17ab98b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:16.297091 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eff6c8-fe85-44ca-8d9d-153c04980a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:16.297700 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eff6c8-fe85-44ca-8d9d-153c04980a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.297980 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eff6c8-fe85-44ca-8d9d-153c04980a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.298259 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eff6c8-fe85-44ca-8d9d-153c04980a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.298917 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eff6c8-fe85-44ca-8d9d-153c04980a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:20:16.299235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eff6c8-fe85-44ca-8d9d-153c04980a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:16.300911 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eff6c8-fe85-44ca-8d9d-153c04980a00 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:16.312924 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1261/2539] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:20:16.317145 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872a78-1bb7-4533-a11b-2da909b5325e None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:16.326833 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872a78-1bb7-4533-a11b-2da909b5325e None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:16.332643 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bdfb5-e6ef-4dc0-87e6-7e016edc55d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:16.333249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bdfb5-e6ef-4dc0-87e6-7e016edc55d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.333526 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bdfb5-e6ef-4dc0-87e6-7e016edc55d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.333798 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bdfb5-e6ef-4dc0-87e6-7e016edc55d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.334434 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bdfb5-e6ef-4dc0-87e6-7e016edc55d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:16.336345 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bdfb5-e6ef-4dc0-87e6-7e016edc55d9 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:16.367745 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1279/2540] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:16 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:16.372105 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eff6c8-fe85-44ca-8d9d-153c04980a00 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:16.382916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eff6c8-fe85-44ca-8d9d-153c04980a00 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:16.440757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a466a-e375-4fcf-8712-1e1992ef1cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:16.441373 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a466a-e375-4fcf-8712-1e1992ef1cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.441656 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a466a-e375-4fcf-8712-1e1992ef1cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.441929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a466a-e375-4fcf-8712-1e1992ef1cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.442551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a466a-e375-4fcf-8712-1e1992ef1cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:16.444596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a466a-e375-4fcf-8712-1e1992ef1cb0 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:16.468256 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1262/2541] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:16 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:16.472500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bdfb5-e6ef-4dc0-87e6-7e016edc55d9 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:16.483419 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bdfb5-e6ef-4dc0-87e6-7e016edc55d9 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:16.488428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ebc8-a50e-4ca6-bba1-38a4d294ae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:16.489026 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ebc8-a50e-4ca6-bba1-38a4d294ae86 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.489305 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ebc8-a50e-4ca6-bba1-38a4d294ae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.489575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ebc8-a50e-4ca6-bba1-38a4d294ae86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.490229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086ebc8-a50e-4ca6-bba1-38a4d294ae86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:16.491843 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086ebc8-a50e-4ca6-bba1-38a4d294ae86 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:16.493162 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:16.504001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1280/2542] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:16.507871 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a466a-e375-4fcf-8712-1e1992ef1cb0 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:16.517969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a466a-e375-4fcf-8712-1e1992ef1cb0 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:16.523699 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9c236-f656-4192-aff7-913fc11b9c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:16.524313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9c236-f656-4192-aff7-913fc11b9c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.524598 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9c236-f656-4192-aff7-913fc11b9c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.524875 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9c236-f656-4192-aff7-913fc11b9c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.525551 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9c236-f656-4192-aff7-913fc11b9c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:16.527207 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9c236-f656-4192-aff7-913fc11b9c2b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:16.538185 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1263/2543] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:16.542486 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ebc8-a50e-4ca6-bba1-38a4d294ae86 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:16.552661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ebc8-a50e-4ca6-bba1-38a4d294ae86 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:16.557834 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe8b35-e7f0-4477-b263-fe120ce8f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:16.558476 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8b35-e7f0-4477-b263-fe120ce8f76f admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.558754 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8b35-e7f0-4477-b263-fe120ce8f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.559030 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8b35-e7f0-4477-b263-fe120ce8f76f admin admin] PATH_INFO: `/v3/projects/67c0392104be4263b0341f5c96ac1ae3/users/d8d578d8dc0d45cdb1d64a444c806a79/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.576779 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe8b35-e7f0-4477-b263-fe120ce8f76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c0392104be4263b0341f5c96ac1ae3, user_id=d8d578d8dc0d45cdb1d64a444c806a79, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:16.579427 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe8b35-e7f0-4477-b263-fe120ce8f76f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:16.596000 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1281/2544] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:16 2022] PUT /identity/v3/projects/67c0392104be4263b0341f5c96ac1ae3/users/d8d578d8dc0d45cdb1d64a444c806a79/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:16.606567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54219-f277-46ca-8746-a778c67814c3 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.606850 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54219-f277-46ca-8746-a778c67814c3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.607128 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54219-f277-46ca-8746-a778c67814c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.636618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f2e54219-f277-46ca-8746-a778c67814c3 None None] MFA Rules not processed for user `d8d578d8dc0d45cdb1d64a444c806a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:16.637870 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f2e54219-f277-46ca-8746-a778c67814c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:16.670179 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:16.705455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1264/2545] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:16.717028 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe8b35-e7f0-4477-b263-fe120ce8f76f admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:16.719097 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b9fe8b35-e7f0-4477-b263-fe120ce8f76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:16.787352 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe8b35-e7f0-4477-b263-fe120ce8f76f admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:16.791942 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3f98e-141f-4604-ad69-867a0204c95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:16.792612 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3f98e-141f-4604-ad69-867a0204c95f service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:16.792877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3f98e-141f-4604-ad69-867a0204c95f service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:16.793148 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3f98e-141f-4604-ad69-867a0204c95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:16.801944 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3f98e-141f-4604-ad69-867a0204c95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:16.803375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3f98e-141f-4604-ad69-867a0204c95f service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:16.812269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1282/2546] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:26.702214 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=12 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:26.808337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:28.412226 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54219-f277-46ca-8746-a778c67814c3 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:28.521808 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54219-f277-46ca-8746-a778c67814c3 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:28.526876 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:28.527507 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:28.527788 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:28.528055 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] PATH_INFO: `/v3/users/d8d578d8dc0d45cdb1d64a444c806a79` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:28.529250 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d578d8dc0d45cdb1d64a444c806a79)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:28.531178 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:28.579343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d578d8dc0d45cdb1d64a444c806a79'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:28.586222 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d578d8dc0d45cdb1d64a444c806a79'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:28.598092 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d578d8dc0d45cdb1d64a444c806a79'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:28.598868 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d578d8dc0d45cdb1d64a444c806a79'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:28.599519 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d578d8dc0d45cdb1d64a444c806a79'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:28.612695 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1265/2547] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:20:28 2022] DELETE /identity/v3/users/d8d578d8dc0d45cdb1d64a444c806a79 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:28.618315 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbafbc-cf62-407b-ac5c-e6246bbec384 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:28.618793 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbafbc-cf62-407b-ac5c-e6246bbec384 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:28.618916 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbafbc-cf62-407b-ac5c-e6246bbec384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:28.673029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-98fbafbc-cf62-407b-ac5c-e6246bbec384 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:28.674232 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-98fbafbc-cf62-407b-ac5c-e6246bbec384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:28.736119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1283/2548] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:28.746211 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:28.747764 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:28.789344 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:28.824771 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57353df8-45ba-41e8-a39e-ddd7fee97044 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:28.828790 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e907df5-7f50-4fe2-99b8-90c6a9697ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:28.829396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907df5-7f50-4fe2-99b8-90c6a9697ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:28.829669 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907df5-7f50-4fe2-99b8-90c6a9697ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:28.829934 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907df5-7f50-4fe2-99b8-90c6a9697ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:28.839852 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e907df5-7f50-4fe2-99b8-90c6a9697ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:28.841352 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e907df5-7f50-4fe2-99b8-90c6a9697ef8 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:28.851657 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1266/2549] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:29.133933 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbafbc-cf62-407b-ac5c-e6246bbec384 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:29.136083 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-98fbafbc-cf62-407b-ac5c-e6246bbec384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:29.151168 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbafbc-cf62-407b-ac5c-e6246bbec384 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:29.158361 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:29.159485 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.159878 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.160267 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] PATH_INFO: `/v3/projects/67c0392104be4263b0341f5c96ac1ae3` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.161951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c0392104be4263b0341f5c96ac1ae3)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:29.164243 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:29.214786 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c0392104be4263b0341f5c96ac1ae3', 'request_id': 'req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:29.220508 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c0392104be4263b0341f5c96ac1ae3', 'request_id': 'req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:29.226865 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c0392104be4263b0341f5c96ac1ae3', 'request_id': 'req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:29.242558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] The token cache is being invalidate because project 67c0392104be4263b0341f5c96ac1ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:20:29.242842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:29.243464 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-1d44fcff-fb39-4b74-b404-3efd3aab4a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:20:29.245049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1284/2550] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:20:29 2022] DELETE /identity/v3/projects/67c0392104be4263b0341f5c96ac1ae3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:29.249945 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8998-95e9-4468-ab17-65a3b04e9881 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.250229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8998-95e9-4468-ab17-65a3b04e9881 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.250501 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8998-95e9-4468-ab17-65a3b04e9881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.300059 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-334b8998-95e9-4468-ab17-65a3b04e9881 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:29.301271 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-334b8998-95e9-4468-ab17-65a3b04e9881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:29.362691 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1267/2551] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:29.426534 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b53a2e-5422-4420-b3bd-1a8a67e6fc0b None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.426814 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b53a2e-5422-4420-b3bd-1a8a67e6fc0b None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.427054 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b53a2e-5422-4420-b3bd-1a8a67e6fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.447906 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-b2b53a2e-5422-4420-b3bd-1a8a67e6fc0b None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:29.449158 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b2b53a2e-5422-4420-b3bd-1a8a67e6fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:29.457142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1285/2552] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:29.461512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b8998-95e9-4468-ab17-65a3b04e9881 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:29.471573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b8998-95e9-4468-ab17-65a3b04e9881 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:29.477313 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f549846-aa4e-4ec1-82af-81d58d632463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:29.477952 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f549846-aa4e-4ec1-82af-81d58d632463 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.478223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f549846-aa4e-4ec1-82af-81d58d632463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.478484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f549846-aa4e-4ec1-82af-81d58d632463 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.479127 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f549846-aa4e-4ec1-82af-81d58d632463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:20:29.479425 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f549846-aa4e-4ec1-82af-81d58d632463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:29.481068 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f549846-aa4e-4ec1-82af-81d58d632463 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:29.493578 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1268/2553] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:20:29.497963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b53a2e-5422-4420-b3bd-1a8a67e6fc0b None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:29.507500 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b53a2e-5422-4420-b3bd-1a8a67e6fc0b None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:29.513552 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf7e06-9c00-40d8-a1ba-9c70f881bb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:29.514155 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7e06-9c00-40d8-a1ba-9c70f881bb18 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.514503 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7e06-9c00-40d8-a1ba-9c70f881bb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.514779 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf7e06-9c00-40d8-a1ba-9c70f881bb18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.515452 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf7e06-9c00-40d8-a1ba-9c70f881bb18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:29.517389 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf7e06-9c00-40d8-a1ba-9c70f881bb18 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:29.547830 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1286/2554] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:20:29 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 13:20:29.554859 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f549846-aa4e-4ec1-82af-81d58d632463 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:29.570026 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f549846-aa4e-4ec1-82af-81d58d632463 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:29.635312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f243a-93af-464b-bb00-ba185fee4981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:29.635982 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f243a-93af-464b-bb00-ba185fee4981 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.636265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f243a-93af-464b-bb00-ba185fee4981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.636567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f243a-93af-464b-bb00-ba185fee4981 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.637200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f243a-93af-464b-bb00-ba185fee4981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:29.639133 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f243a-93af-464b-bb00-ba185fee4981 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:29.663317 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1269/2555] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:20:29 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:20:29.667620 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf7e06-9c00-40d8-a1ba-9c70f881bb18 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:29.678373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf7e06-9c00-40d8-a1ba-9c70f881bb18 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:29.683404 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61f74a-259b-420e-9103-0f537244de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:29.684001 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61f74a-259b-420e-9103-0f537244de38 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.684282 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61f74a-259b-420e-9103-0f537244de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.684587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61f74a-259b-420e-9103-0f537244de38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.685238 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61f74a-259b-420e-9103-0f537244de38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:29.686831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61f74a-259b-420e-9103-0f537244de38 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:29.696908 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1287/2556] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:29.700869 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f243a-93af-464b-bb00-ba185fee4981 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:29.711311 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f243a-93af-464b-bb00-ba185fee4981 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:29.716095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e162af2-4615-4e04-9105-562ee531ca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:29.716725 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162af2-4615-4e04-9105-562ee531ca82 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.716996 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162af2-4615-4e04-9105-562ee531ca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.717270 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162af2-4615-4e04-9105-562ee531ca82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.717914 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e162af2-4615-4e04-9105-562ee531ca82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:29.719503 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e162af2-4615-4e04-9105-562ee531ca82 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:29.730388 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1270/2557] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:20:29.735023 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61f74a-259b-420e-9103-0f537244de38 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:29.745218 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61f74a-259b-420e-9103-0f537244de38 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:29.750143 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05045a-e496-45fe-bcde-76da215524f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:29.750801 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05045a-e496-45fe-bcde-76da215524f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.751085 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05045a-e496-45fe-bcde-76da215524f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.751364 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05045a-e496-45fe-bcde-76da215524f6 admin admin] PATH_INFO: `/v3/projects/108940dcc0194b93a3d2944d0f7c553e/users/ca0af3ad948a473ea045df8abf48a76d/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.766282 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05045a-e496-45fe-bcde-76da215524f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108940dcc0194b93a3d2944d0f7c553e, user_id=ca0af3ad948a473ea045df8abf48a76d, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:29.769015 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05045a-e496-45fe-bcde-76da215524f6 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:29.771253 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:29.784213 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1288/2558] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:20:29 2022] PUT /identity/v3/projects/108940dcc0194b93a3d2944d0f7c553e/users/ca0af3ad948a473ea045df8abf48a76d/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:20:29.789379 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc60c93-3402-4d13-a079-4fcce535bb8c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.789667 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc60c93-3402-4d13-a079-4fcce535bb8c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.789963 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc60c93-3402-4d13-a079-4fcce535bb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.803767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:29.810573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ffc60c93-3402-4d13-a079-4fcce535bb8c None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:29.812406 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ffc60c93-3402-4d13-a079-4fcce535bb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:29.874746 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1271/2559] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:29.884558 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05045a-e496-45fe-bcde-76da215524f6 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:29.886362 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-5b05045a-e496-45fe-bcde-76da215524f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:29.944877 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05045a-e496-45fe-bcde-76da215524f6 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:29.949076 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b756c2-4043-4105-bae0-f3fa932f8a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:29.949682 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b756c2-4043-4105-bae0-f3fa932f8a65 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:29.949963 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b756c2-4043-4105-bae0-f3fa932f8a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:29.950235 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b756c2-4043-4105-bae0-f3fa932f8a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:29.959802 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b756c2-4043-4105-bae0-f3fa932f8a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:29.961320 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b756c2-4043-4105-bae0-f3fa932f8a65 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:29.970825 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1289/2560] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:30.589006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde968-c995-4cf5-8107-bb9be5cc1545 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:30.589549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde968-c995-4cf5-8107-bb9be5cc1545 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:30.589549 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde968-c995-4cf5-8107-bb9be5cc1545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:30.618854 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2acde968-c995-4cf5-8107-bb9be5cc1545 None None] MFA Rules not processed for user `ca0af3ad948a473ea045df8abf48a76d`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:30.620008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2acde968-c995-4cf5-8107-bb9be5cc1545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:30.687757 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1272/2561] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:30.698830 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b756c2-4043-4105-bae0-f3fa932f8a65 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:30.700268 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-d2b756c2-4043-4105-bae0-f3fa932f8a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:30.758617 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b756c2-4043-4105-bae0-f3fa932f8a65 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:30.762275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84b7e5-99b4-45e1-9a7d-52234968383e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:30.762881 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b7e5-99b4-45e1-9a7d-52234968383e service cinder] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:30.763161 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b7e5-99b4-45e1-9a7d-52234968383e service cinder] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:30.763428 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b7e5-99b4-45e1-9a7d-52234968383e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:30.772216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84b7e5-99b4-45e1-9a7d-52234968383e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:30.773684 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84b7e5-99b4-45e1-9a7d-52234968383e service cinder] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:30.782309 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1290/2562] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:32.162369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc993-2694-4383-932a-9b30a471e70f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:32.163202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc993-2694-4383-932a-9b30a471e70f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:32.163202 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc993-2694-4383-932a-9b30a471e70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:32.188608 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1a2cc993-2694-4383-932a-9b30a471e70f None None] MFA Rules not processed for user `ca0af3ad948a473ea045df8abf48a76d`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:32.189826 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1a2cc993-2694-4383-932a-9b30a471e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:32.198356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1273/2563] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:20:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:32.435280 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84b7e5-99b4-45e1-9a7d-52234968383e service cinder] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:32.445809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84b7e5-99b4-45e1-9a7d-52234968383e service cinder] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:32.450504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8521e89-ed22-41bc-a3af-bee0e9936fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:32.451110 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8521e89-ed22-41bc-a3af-bee0e9936fbf service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:32.451372 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8521e89-ed22-41bc-a3af-bee0e9936fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:32.451694 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8521e89-ed22-41bc-a3af-bee0e9936fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:32.453615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e8521e89-ed22-41bc-a3af-bee0e9936fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:32.463269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8521e89-ed22-41bc-a3af-bee0e9936fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:32.464715 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8521e89-ed22-41bc-a3af-bee0e9936fbf service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:32.473605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1291/2564] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:37.359023 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc993-2694-4383-932a-9b30a471e70f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:37.360742 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1a2cc993-2694-4383-932a-9b30a471e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:37.457377 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc993-2694-4383-932a-9b30a471e70f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:37.462413 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6db36-1ced-428a-a6d0-30c03460f57b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:37.463021 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6db36-1ced-428a-a6d0-30c03460f57b service placement] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:37.463296 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6db36-1ced-428a-a6d0-30c03460f57b service placement] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:37.463561 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6db36-1ced-428a-a6d0-30c03460f57b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:37.465290 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-aab6db36-1ced-428a-a6d0-30c03460f57b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:37.476839 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6db36-1ced-428a-a6d0-30c03460f57b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:37.478580 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6db36-1ced-428a-a6d0-30c03460f57b service placement] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:37.484195 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:37.491341 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1274/2565] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:20:42.469104 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:INSERT=1,keystone:SELECT=60 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:57.516477 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e32c-5a92-4a2f-aaea-2f6d18195c38 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:57.517524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e32c-5a92-4a2f-aaea-2f6d18195c38 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:57.517524 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e32c-5a92-4a2f-aaea-2f6d18195c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:57.541685 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-28a2e32c-5a92-4a2f-aaea-2f6d18195c38 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:20:57.542926 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-28a2e32c-5a92-4a2f-aaea-2f6d18195c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:57.552766 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1292/2566] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:20:57.592408 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6db36-1ced-428a-a6d0-30c03460f57b service placement] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:20:57.594045 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-aab6db36-1ced-428a-a6d0-30c03460f57b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:20:57.701984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6db36-1ced-428a-a6d0-30c03460f57b service placement] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:20:57.708000 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c64c5-e503-4581-8af8-cd1eca53d978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:20:57.708648 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c64c5-e503-4581-8af8-cd1eca53d978 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:20:57.708926 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c64c5-e503-4581-8af8-cd1eca53d978 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:20:57.709190 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c64c5-e503-4581-8af8-cd1eca53d978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:20:57.717601 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c64c5-e503-4581-8af8-cd1eca53d978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:20:57.719196 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c64c5-e503-4581-8af8-cd1eca53d978 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:20:57.729109 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1275/2567] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:00.620821 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b98f3d-eb8d-4f1b-a186-9702a4efc336 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:00.621408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b98f3d-eb8d-4f1b-a186-9702a4efc336 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:00.621408 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b98f3d-eb8d-4f1b-a186-9702a4efc336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:00.642992 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-14b98f3d-eb8d-4f1b-a186-9702a4efc336 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:00.644347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-14b98f3d-eb8d-4f1b-a186-9702a4efc336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:00.653341 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1293/2568] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:00.673772 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c64c5-e503-4581-8af8-cd1eca53d978 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:00.675458 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-175c64c5-e503-4581-8af8-cd1eca53d978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:00.690953 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c64c5-e503-4581-8af8-cd1eca53d978 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:00.697369 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4392aee-85e2-40d6-a860-2f49254f053a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:00.698008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392aee-85e2-40d6-a860-2f49254f053a service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:00.698264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392aee-85e2-40d6-a860-2f49254f053a service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:00.698559 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392aee-85e2-40d6-a860-2f49254f053a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:00.707701 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4392aee-85e2-40d6-a860-2f49254f053a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:00.709355 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4392aee-85e2-40d6-a860-2f49254f053a service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:00.719148 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1276/2569] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:03.912455 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea68e-d3c5-454e-99f8-4bddeab8f023 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:03.912972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea68e-d3c5-454e-99f8-4bddeab8f023 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:03.912972 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea68e-d3c5-454e-99f8-4bddeab8f023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:03.933815 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-76bea68e-d3c5-454e-99f8-4bddeab8f023 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:03.934996 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-76bea68e-d3c5-454e-99f8-4bddeab8f023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:03.944390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1294/2570] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:03.963223 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4392aee-85e2-40d6-a860-2f49254f053a service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:03.974847 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4392aee-85e2-40d6-a860-2f49254f053a service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:03.981878 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886609c-bf75-477c-abf7-4cf7ec40fb02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:03.982467 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886609c-bf75-477c-abf7-4cf7ec40fb02 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:03.982744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886609c-bf75-477c-abf7-4cf7ec40fb02 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:03.983008 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886609c-bf75-477c-abf7-4cf7ec40fb02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:03.991273 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886609c-bf75-477c-abf7-4cf7ec40fb02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:03.992910 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886609c-bf75-477c-abf7-4cf7ec40fb02 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:04.002359 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1277/2571] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:07.018162 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e4f2-cd5e-46e9-80a2-4764e70d3ccf None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:07.018680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e4f2-cd5e-46e9-80a2-4764e70d3ccf None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:07.018680 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e4f2-cd5e-46e9-80a2-4764e70d3ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:07.040401 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-59f1e4f2-cd5e-46e9-80a2-4764e70d3ccf None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:07.041602 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-59f1e4f2-cd5e-46e9-80a2-4764e70d3ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:07.049965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1295/2572] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:07.087828 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886609c-bf75-477c-abf7-4cf7ec40fb02 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:07.099961 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886609c-bf75-477c-abf7-4cf7ec40fb02 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:07.108077 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102299d-1254-4f93-910b-ac551fe24085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:07.108709 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102299d-1254-4f93-910b-ac551fe24085 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:07.108988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102299d-1254-4f93-910b-ac551fe24085 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:07.109257 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102299d-1254-4f93-910b-ac551fe24085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:07.118969 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102299d-1254-4f93-910b-ac551fe24085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:07.120675 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102299d-1254-4f93-910b-ac551fe24085 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:07.132718 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1278/2573] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:10.217770 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16ca30-6d69-4c88-80d5-ef7fb3b0f22e None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:10.218322 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16ca30-6d69-4c88-80d5-ef7fb3b0f22e None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:10.218430 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16ca30-6d69-4c88-80d5-ef7fb3b0f22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:10.238752 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-7b16ca30-6d69-4c88-80d5-ef7fb3b0f22e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:10.239946 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-7b16ca30-6d69-4c88-80d5-ef7fb3b0f22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:10.248036 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1296/2574] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:21:10.286031 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102299d-1254-4f93-910b-ac551fe24085 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:10.298024 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102299d-1254-4f93-910b-ac551fe24085 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:10.304968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60874-07e5-4835-84c6-cfb4526df88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:10.305563 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60874-07e5-4835-84c6-cfb4526df88d service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:10.305855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60874-07e5-4835-84c6-cfb4526df88d service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:10.306110 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60874-07e5-4835-84c6-cfb4526df88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:10.314391 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df60874-07e5-4835-84c6-cfb4526df88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:10.316021 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df60874-07e5-4835-84c6-cfb4526df88d service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:10.325564 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1279/2575] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:13.401312 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f279e9a-5567-466c-863e-15e25f6aa19f None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:13.401896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f279e9a-5567-466c-863e-15e25f6aa19f None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:13.401896 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f279e9a-5567-466c-863e-15e25f6aa19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:13.422576 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-3f279e9a-5567-466c-863e-15e25f6aa19f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:13.423852 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-3f279e9a-5567-466c-863e-15e25f6aa19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:13.432375 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1297/2576] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:13.464626 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60874-07e5-4835-84c6-cfb4526df88d service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:13.476247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60874-07e5-4835-84c6-cfb4526df88d service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:13.483280 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c353a-70a9-40f1-a44f-083fa6d83a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:13.483863 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c353a-70a9-40f1-a44f-083fa6d83a81 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:13.484146 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c353a-70a9-40f1-a44f-083fa6d83a81 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:13.484455 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c353a-70a9-40f1-a44f-083fa6d83a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:13.499489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c353a-70a9-40f1-a44f-083fa6d83a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:13.501176 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c353a-70a9-40f1-a44f-083fa6d83a81 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:13.516572 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1280/2577] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:23.417070 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=18 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:23.508539 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=76 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:28.822390 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876f374-cb2f-4b65-9fbf-35c18887a0cc None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:28.822909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876f374-cb2f-4b65-9fbf-35c18887a0cc None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:28.822909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876f374-cb2f-4b65-9fbf-35c18887a0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:28.850032 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9876f374-cb2f-4b65-9fbf-35c18887a0cc None None] MFA Rules not processed for user `ca0af3ad948a473ea045df8abf48a76d`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:28.851912 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9876f374-cb2f-4b65-9fbf-35c18887a0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:28.862951 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1298/2578] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:21:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:38.840690 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:41.702095 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95409f85-3676-4f86-a8cc-134db835713f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:41.702651 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95409f85-3676-4f86-a8cc-134db835713f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:41.702815 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95409f85-3676-4f86-a8cc-134db835713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:41.723285 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-95409f85-3676-4f86-a8cc-134db835713f None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:41.724534 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-95409f85-3676-4f86-a8cc-134db835713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:41.733989 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1281/2579] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:41.774318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876f374-cb2f-4b65-9fbf-35c18887a0cc None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:41.788108 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876f374-cb2f-4b65-9fbf-35c18887a0cc None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:41.794906 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5be8fd-8ef0-48cb-9b96-7c946cd45075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:41.795515 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be8fd-8ef0-48cb-9b96-7c946cd45075 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:41.795759 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be8fd-8ef0-48cb-9b96-7c946cd45075 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:41.796062 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be8fd-8ef0-48cb-9b96-7c946cd45075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:41.804513 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5be8fd-8ef0-48cb-9b96-7c946cd45075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:41.806100 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5be8fd-8ef0-48cb-9b96-7c946cd45075 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:41.815454 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1299/2580] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:45.003956 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edef94-bc49-4ef5-a784-7b48680f568e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:45.004645 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edef94-bc49-4ef5-a784-7b48680f568e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:45.004645 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edef94-bc49-4ef5-a784-7b48680f568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:45.025573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-01edef94-bc49-4ef5-a784-7b48680f568e None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:45.026878 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-01edef94-bc49-4ef5-a784-7b48680f568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:45.036264 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1282/2581] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:45.056470 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5be8fd-8ef0-48cb-9b96-7c946cd45075 service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:45.067797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5be8fd-8ef0-48cb-9b96-7c946cd45075 service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:45.074532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358c82-974b-49e3-b445-05bd5b683033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:45.075124 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358c82-974b-49e3-b445-05bd5b683033 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:45.075399 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358c82-974b-49e3-b445-05bd5b683033 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:45.075667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358c82-974b-49e3-b445-05bd5b683033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:45.084565 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358c82-974b-49e3-b445-05bd5b683033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:45.086141 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358c82-974b-49e3-b445-05bd5b683033 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:45.095778 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1300/2582] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:48.114084 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85b9e5-f997-4bac-914e-0c000b745617 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:48.114620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85b9e5-f997-4bac-914e-0c000b745617 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:48.114620 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85b9e5-f997-4bac-914e-0c000b745617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:48.134900 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1c85b9e5-f997-4bac-914e-0c000b745617 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:48.136118 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1c85b9e5-f997-4bac-914e-0c000b745617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:48.145281 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1283/2583] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:48.162119 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358c82-974b-49e3-b445-05bd5b683033 service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:48.173543 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358c82-974b-49e3-b445-05bd5b683033 service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:48.179832 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd46bbb-af7a-4558-a295-b6eca4b4d727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:48.180463 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd46bbb-af7a-4558-a295-b6eca4b4d727 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:48.180772 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd46bbb-af7a-4558-a295-b6eca4b4d727 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:48.181142 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd46bbb-af7a-4558-a295-b6eca4b4d727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:48.189863 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd46bbb-af7a-4558-a295-b6eca4b4d727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:48.191431 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd46bbb-af7a-4558-a295-b6eca4b4d727 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:48.200763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1301/2584] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:51.312912 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ec2b8-3e71-49f1-ad39-9168cd534184 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:51.313456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ec2b8-3e71-49f1-ad39-9168cd534184 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:51.313456 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ec2b8-3e71-49f1-ad39-9168cd534184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:51.334235 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e58ec2b8-3e71-49f1-ad39-9168cd534184 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:51.335444 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e58ec2b8-3e71-49f1-ad39-9168cd534184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:51.344069 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1284/2585] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:51.365010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd46bbb-af7a-4558-a295-b6eca4b4d727 service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:51.376608 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd46bbb-af7a-4558-a295-b6eca4b4d727 service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:51.383222 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbdab2-5812-4ba4-ad8f-3ff6dbcdd1df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:51.383824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbdab2-5812-4ba4-ad8f-3ff6dbcdd1df service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:51.384102 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbdab2-5812-4ba4-ad8f-3ff6dbcdd1df service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:51.384414 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbdab2-5812-4ba4-ad8f-3ff6dbcdd1df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:51.393121 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbdab2-5812-4ba4-ad8f-3ff6dbcdd1df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:51.394687 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbdab2-5812-4ba4-ad8f-3ff6dbcdd1df service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:51.405050 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1302/2586] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:21:56.567395 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f087c9-2bc2-44fd-b473-178c4c2840a4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:56.567902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f087c9-2bc2-44fd-b473-178c4c2840a4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:56.567902 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f087c9-2bc2-44fd-b473-178c4c2840a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:56.588799 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-78f087c9-2bc2-44fd-b473-178c4c2840a4 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:21:56.590006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-78f087c9-2bc2-44fd-b473-178c4c2840a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:21:56.598470 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1285/2587] 10.222.0.13 () {58 vars in 1016 bytes} [Mon Oct 24 13:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:21:56.615728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbdab2-5812-4ba4-ad8f-3ff6dbcdd1df service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:21:56.627242 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbdab2-5812-4ba4-ad8f-3ff6dbcdd1df service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:21:56.633629 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293b286-b696-4274-a662-f437676e64b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:21:56.634229 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b286-b696-4274-a662-f437676e64b6 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:21:56.634507 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b286-b696-4274-a662-f437676e64b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:21:56.634779 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b286-b696-4274-a662-f437676e64b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:21:56.643746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293b286-b696-4274-a662-f437676e64b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:21:56.645456 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293b286-b696-4274-a662-f437676e64b6 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:21:56.654908 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1303/2588] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:22:06.583267 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=15 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:06.650785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=30 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:24.922916 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f087c9-2bc2-44fd-b473-178c4c2840a4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:24.933342 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f087c9-2bc2-44fd-b473-178c4c2840a4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:24.939082 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:24.939703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:24.939978 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:24.940247 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] PATH_INFO: `/v3/users/ca0af3ad948a473ea045df8abf48a76d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:24.941703 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0af3ad948a473ea045df8abf48a76d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:24.943641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:24.994375 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0af3ad948a473ea045df8abf48a76d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:22:25.001225 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0af3ad948a473ea045df8abf48a76d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:22:25.012811 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0af3ad948a473ea045df8abf48a76d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:22:25.013471 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0af3ad948a473ea045df8abf48a76d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:22:25.014147 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-8b2495b6-98c4-4553-bad3-a37aba610fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0af3ad948a473ea045df8abf48a76d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:22:25.028066 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1286/2589] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:22:24 2022] DELETE /identity/v3/users/ca0af3ad948a473ea045df8abf48a76d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:22:25.207137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293b286-b696-4274-a662-f437676e64b6 service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:25.217249 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293b286-b696-4274-a662-f437676e64b6 service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:25.276731 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:25.277423 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:25.277664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:25.277934 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] PATH_INFO: `/v3/projects/108940dcc0194b93a3d2944d0f7c553e` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:25.279034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=108940dcc0194b93a3d2944d0f7c553e)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:25.281089 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:25.329824 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108940dcc0194b93a3d2944d0f7c553e', 'request_id': 'req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:22:25.335785 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108940dcc0194b93a3d2944d0f7c553e', 'request_id': 'req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:22:25.342159 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108940dcc0194b93a3d2944d0f7c553e', 'request_id': 'req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:22:25.356460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] The token cache is being invalidate because project 108940dcc0194b93a3d2944d0f7c553e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:22:25.356746 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:22:25.357420 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-dd5608bb-6a8d-40f8-89b4-78fc8e52e861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:22:25.358986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1304/2590] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:22:25 2022] DELETE /identity/v3/projects/108940dcc0194b93a3d2944d0f7c553e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:22:25.364732 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb67e-e6bd-4820-886a-f98e508ed896 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:25.365018 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb67e-e6bd-4820-886a-f98e508ed896 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:25.365287 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb67e-e6bd-4820-886a-f98e508ed896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:25.385935 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-23dcb67e-e6bd-4820-886a-f98e508ed896 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:22:25.387171 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-23dcb67e-e6bd-4820-886a-f98e508ed896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:25.448265 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1287/2591] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:22:25.456446 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d576-876b-46e0-bf62-f1d8aa99b376 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:25.456732 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d576-876b-46e0-bf62-f1d8aa99b376 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:25.457006 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d576-876b-46e0-bf62-f1d8aa99b376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:25.478308 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-4585d576-876b-46e0-bf62-f1d8aa99b376 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:22:25.479887 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-4585d576-876b-46e0-bf62-f1d8aa99b376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:25.488757 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1305/2592] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:22:25.493279 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcb67e-e6bd-4820-886a-f98e508ed896 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:25.503670 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcb67e-e6bd-4820-886a-f98e508ed896 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:25.509075 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773ca9-74be-4ed5-b78c-fb76be345418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:25.509688 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773ca9-74be-4ed5-b78c-fb76be345418 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:25.509968 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773ca9-74be-4ed5-b78c-fb76be345418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:25.510357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773ca9-74be-4ed5-b78c-fb76be345418 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:25.511014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773ca9-74be-4ed5-b78c-fb76be345418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 13:22:25.511320 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773ca9-74be-4ed5-b78c-fb76be345418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:25.512986 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773ca9-74be-4ed5-b78c-fb76be345418 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:25.525126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1288/2593] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Oct 24 13:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 13:22:25.529563 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585d576-876b-46e0-bf62-f1d8aa99b376 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:25.539004 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585d576-876b-46e0-bf62-f1d8aa99b376 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:25.544797 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcd189-95b5-4673-8ff3-706874ffd231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:25.545451 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcd189-95b5-4673-8ff3-706874ffd231 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:25.545727 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcd189-95b5-4673-8ff3-706874ffd231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:25.545986 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcd189-95b5-4673-8ff3-706874ffd231 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:25.546615 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcd189-95b5-4673-8ff3-706874ffd231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:25.548549 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcd189-95b5-4673-8ff3-706874ffd231 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:25.576325 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1306/2594] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:22:25 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:22:25.581164 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773ca9-74be-4ed5-b78c-fb76be345418 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:25.597231 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773ca9-74be-4ed5-b78c-fb76be345418 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:25.663779 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4663b-3a79-44d8-b07b-c0083482ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:25.664489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4663b-3a79-44d8-b07b-c0083482ff83 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:25.664769 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4663b-3a79-44d8-b07b-c0083482ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:25.665036 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4663b-3a79-44d8-b07b-c0083482ff83 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:25.665676 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4663b-3a79-44d8-b07b-c0083482ff83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:25.667617 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4663b-3a79-44d8-b07b-c0083482ff83 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:25.675735 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:25.691754 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1289/2595] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:22:25 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:22:25.698831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcd189-95b5-4673-8ff3-706874ffd231 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:25.709842 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcd189-95b5-4673-8ff3-706874ffd231 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:25.715800 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a5685-17a7-4a60-8b20-0e7cd5e0d2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:25.716461 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a5685-17a7-4a60-8b20-0e7cd5e0d2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:25.716739 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a5685-17a7-4a60-8b20-0e7cd5e0d2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:25.717011 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a5685-17a7-4a60-8b20-0e7cd5e0d2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:25.717659 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a5685-17a7-4a60-8b20-0e7cd5e0d2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:25.719347 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a5685-17a7-4a60-8b20-0e7cd5e0d2d2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:25.730078 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1307/2596] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:22:25.734367 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4663b-3a79-44d8-b07b-c0083482ff83 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:25.745141 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4663b-3a79-44d8-b07b-c0083482ff83 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:25.751014 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5181f-5fa1-44f0-8838-397e9e13721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:25.751621 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5181f-5fa1-44f0-8838-397e9e13721b admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:25.751929 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5181f-5fa1-44f0-8838-397e9e13721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:25.752200 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5181f-5fa1-44f0-8838-397e9e13721b admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:25.752878 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5181f-5fa1-44f0-8838-397e9e13721b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:25.754494 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5181f-5fa1-44f0-8838-397e9e13721b admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:25.766229 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1290/2597] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:22:25.770373 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a5685-17a7-4a60-8b20-0e7cd5e0d2d2 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:25.780981 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a5685-17a7-4a60-8b20-0e7cd5e0d2d2 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:25.786460 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2487c-3bc8-4829-911c-1cbd42fd1623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:25.787115 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2487c-3bc8-4829-911c-1cbd42fd1623 admin admin] REQUEST_METHOD: `PUT` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:25.787395 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2487c-3bc8-4829-911c-1cbd42fd1623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:25.787665 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2487c-3bc8-4829-911c-1cbd42fd1623 admin admin] PATH_INFO: `/v3/projects/336ab415ef6348a5a2e86beb90b8d853/users/ab1533f90ee04e009967a27e84beaaf4/roles/5a473059a779480ca6031449b18aeb52` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:25.802810 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2487c-3bc8-4829-911c-1cbd42fd1623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336ab415ef6348a5a2e86beb90b8d853, user_id=ab1533f90ee04e009967a27e84beaaf4, role_id=5a473059a779480ca6031449b18aeb52)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:25.805550 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2487c-3bc8-4829-911c-1cbd42fd1623 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:25.820532 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1308/2598] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:22:25 2022] PUT /identity/v3/projects/336ab415ef6348a5a2e86beb90b8d853/users/ab1533f90ee04e009967a27e84beaaf4/roles/5a473059a779480ca6031449b18aeb52 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:22:25.826439 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db00b8c-1014-44b2-9851-6fbf1fd69941 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:25.826729 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db00b8c-1014-44b2-9851-6fbf1fd69941 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:25.827003 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db00b8c-1014-44b2-9851-6fbf1fd69941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:25.847172 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2db00b8c-1014-44b2-9851-6fbf1fd69941 None None] MFA Rules not processed for user `7a57e5ee78334c3d8abcf656f9c79512`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:22:25.848067 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2db00b8c-1014-44b2-9851-6fbf1fd69941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:25.910371 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1291/2599] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:22:25.920530 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2487c-3bc8-4829-911c-1cbd42fd1623 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:25.922410 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bef2487c-3bc8-4829-911c-1cbd42fd1623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:25.955562 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:26.009112 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2487c-3bc8-4829-911c-1cbd42fd1623 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:26.013283 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97cad4-9524-4ef0-99b3-4d3bbc5220ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:26.013907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97cad4-9524-4ef0-99b3-4d3bbc5220ac service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:26.014186 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97cad4-9524-4ef0-99b3-4d3bbc5220ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:26.014489 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97cad4-9524-4ef0-99b3-4d3bbc5220ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:26.024190 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97cad4-9524-4ef0-99b3-4d3bbc5220ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:26.025671 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97cad4-9524-4ef0-99b3-4d3bbc5220ac service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:26.035469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1309/2600] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:22:29.901593 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6d74-cdd1-48b3-9976-f0990f65c836 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:29.902157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6d74-cdd1-48b3-9976-f0990f65c836 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:29.902157 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6d74-cdd1-48b3-9976-f0990f65c836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:29.938134 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9ddf6d74-cdd1-48b3-9976-f0990f65c836 None None] MFA Rules not processed for user `ab1533f90ee04e009967a27e84beaaf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:22:29.939445 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9ddf6d74-cdd1-48b3-9976-f0990f65c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:30.007435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1292/2601] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:22:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:22:30.012136 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97cad4-9524-4ef0-99b3-4d3bbc5220ac service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:30.022211 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97cad4-9524-4ef0-99b3-4d3bbc5220ac service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:30.027137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72917eb-d67a-4b72-8d47-be42c734eaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:30.027764 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72917eb-d67a-4b72-8d47-be42c734eaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:30.028041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72917eb-d67a-4b72-8d47-be42c734eaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:30.028363 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72917eb-d67a-4b72-8d47-be42c734eaf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:30.029034 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72917eb-d67a-4b72-8d47-be42c734eaf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:30.030998 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72917eb-d67a-4b72-8d47-be42c734eaf1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:30.073831 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1310/2602] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Oct 24 13:22:30 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:22:30.078009 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6d74-cdd1-48b3-9976-f0990f65c836 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:30.089054 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6d74-cdd1-48b3-9976-f0990f65c836 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:30.147518 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c6a25-f2e0-4bf8-bc6c-709cd2db8e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:30.148122 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c6a25-f2e0-4bf8-bc6c-709cd2db8e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:30.148435 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c6a25-f2e0-4bf8-bc6c-709cd2db8e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:30.148696 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c6a25-f2e0-4bf8-bc6c-709cd2db8e70 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:30.149356 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c6a25-f2e0-4bf8-bc6c-709cd2db8e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:30.151440 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c6a25-f2e0-4bf8-bc6c-709cd2db8e70 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:30.169583 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:30.179855 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1293/2603] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Oct 24 13:22:30 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 13:22:30.180809 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72917eb-d67a-4b72-8d47-be42c734eaf1 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:30.191929 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72917eb-d67a-4b72-8d47-be42c734eaf1 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:30.196736 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47acf9-62f9-4b29-a1b1-811f0bcba7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:30.197387 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47acf9-62f9-4b29-a1b1-811f0bcba7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:30.197664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47acf9-62f9-4b29-a1b1-811f0bcba7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:30.198010 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47acf9-62f9-4b29-a1b1-811f0bcba7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:30.198664 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47acf9-62f9-4b29-a1b1-811f0bcba7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:30.200275 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47acf9-62f9-4b29-a1b1-811f0bcba7a7 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:30.211236 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1311/2604] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:22:30.215750 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c6a25-f2e0-4bf8-bc6c-709cd2db8e70 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:30.228006 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c6a25-f2e0-4bf8-bc6c-709cd2db8e70 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:30.233778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4712b-280c-46bf-b3a6-b2248d9400dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:30.234722 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4712b-280c-46bf-b3a6-b2248d9400dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:30.235061 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4712b-280c-46bf-b3a6-b2248d9400dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:30.235407 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4712b-280c-46bf-b3a6-b2248d9400dd admin admin] PATH_INFO: `/v3/projects/fda0afea3d42458eb2ab9703c2b845b3/users/6343f166a3de4f8e88312a4935345593/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:30.251484 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4712b-280c-46bf-b3a6-b2248d9400dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda0afea3d42458eb2ab9703c2b845b3, user_id=6343f166a3de4f8e88312a4935345593, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:30.254249 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4712b-280c-46bf-b3a6-b2248d9400dd admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:30.269153 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1294/2605] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:22:30 2022] PUT /identity/v3/projects/fda0afea3d42458eb2ab9703c2b845b3/users/6343f166a3de4f8e88312a4935345593/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:22:30.273337 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47acf9-62f9-4b29-a1b1-811f0bcba7a7 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:30.283964 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47acf9-62f9-4b29-a1b1-811f0bcba7a7 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:30.345969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282c61-f8d4-4346-9d7c-dd005d3674e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:30.346592 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282c61-f8d4-4346-9d7c-dd005d3674e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:30.346894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282c61-f8d4-4346-9d7c-dd005d3674e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:30.347120 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282c61-f8d4-4346-9d7c-dd005d3674e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:30.347783 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0282c61-f8d4-4346-9d7c-dd005d3674e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:30.349667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0282c61-f8d4-4346-9d7c-dd005d3674e1 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:30.361482 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1312/2606] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Oct 24 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 13:22:30.365605 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4712b-280c-46bf-b3a6-b2248d9400dd admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:30.376330 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4712b-280c-46bf-b3a6-b2248d9400dd admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:30.381354 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc60493-fa34-41d7-a1c5-a7fbf1e1b027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:30.382030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc60493-fa34-41d7-a1c5-a7fbf1e1b027 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:30.382312 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc60493-fa34-41d7-a1c5-a7fbf1e1b027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:30.382586 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc60493-fa34-41d7-a1c5-a7fbf1e1b027 admin admin] PATH_INFO: `/v3/projects/fda0afea3d42458eb2ab9703c2b845b3/users/6343f166a3de4f8e88312a4935345593/roles/67447f88528849c59df641acc7768c92` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:30.384641 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc60493-fa34-41d7-a1c5-a7fbf1e1b027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda0afea3d42458eb2ab9703c2b845b3, user_id=6343f166a3de4f8e88312a4935345593, role_id=67447f88528849c59df641acc7768c92)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:30.387287 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc60493-fa34-41d7-a1c5-a7fbf1e1b027 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:30.397830 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1295/2607] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Oct 24 13:22:30 2022] PUT /identity/v3/projects/fda0afea3d42458eb2ab9703c2b845b3/users/6343f166a3de4f8e88312a4935345593/roles/67447f88528849c59df641acc7768c92 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:22:34.662076 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba6a9f-bcf3-448a-805e-6239d5b100d8 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:34.662572 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba6a9f-bcf3-448a-805e-6239d5b100d8 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:34.662843 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba6a9f-bcf3-448a-805e-6239d5b100d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:34.695429 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-9fba6a9f-bcf3-448a-805e-6239d5b100d8 None None] MFA Rules not processed for user `6343f166a3de4f8e88312a4935345593`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:22:34.696733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9fba6a9f-bcf3-448a-805e-6239d5b100d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:34.758738 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:34.781170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1313/2608] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:22:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 13:22:34.798686 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc60493-fa34-41d7-a1c5-a7fbf1e1b027 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:34.800995 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5cc60493-fa34-41d7-a1c5-a7fbf1e1b027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:34.902603 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc60493-fa34-41d7-a1c5-a7fbf1e1b027 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:34.911815 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d38ec7-2e11-43ba-8660-c781b59bbc02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:34.912544 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d38ec7-2e11-43ba-8660-c781b59bbc02 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:34.914132 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d38ec7-2e11-43ba-8660-c781b59bbc02 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:34.914132 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d38ec7-2e11-43ba-8660-c781b59bbc02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:34.983512 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d38ec7-2e11-43ba-8660-c781b59bbc02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:34.985208 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d38ec7-2e11-43ba-8660-c781b59bbc02 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:34.995057 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1296/2609] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:22:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:22:36.019503 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4f70-2853-41cb-a6a4-25c18d04e012 None None] REQUEST_METHOD: `POST` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:36.020049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4f70-2853-41cb-a6a4-25c18d04e012 None None] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:36.020049 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4f70-2853-41cb-a6a4-25c18d04e012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:36.039614 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.auth.core [None req-bf5e4f70-2853-41cb-a6a4-25c18d04e012 None None] MFA Rules not processed for user `ab1533f90ee04e009967a27e84beaaf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 13:22:36.040836 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-bf5e4f70-2853-41cb-a6a4-25c18d04e012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:36.049318 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1314/2610] 10.222.0.15 () {58 vars in 958 bytes} [Mon Oct 24 13:22:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 13:22:44.991643 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:46.033909 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=8 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:50.329221 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d38ec7-2e11-43ba-8660-c781b59bbc02 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:50.330776 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e8d38ec7-2e11-43ba-8660-c781b59bbc02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:50.411150 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d38ec7-2e11-43ba-8660-c781b59bbc02 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:50.415126 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fa0f-7b1c-49e3-b5ff-8b9303336846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9b6f4afedfc4d45995b8a671e2d01e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:50.415730 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fa0f-7b1c-49e3-b5ff-8b9303336846 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:50.416010 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fa0f-7b1c-49e3-b5ff-8b9303336846 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:50.416325 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fa0f-7b1c-49e3-b5ff-8b9303336846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:50.418287 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d0f4fa0f-7b1c-49e3-b5ff-8b9303336846 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:50.432624 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4fa0f-7b1c-49e3-b5ff-8b9303336846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:50.434053 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4fa0f-7b1c-49e3-b5ff-8b9303336846 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:50.444941 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1297/2611] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:22:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:22:51.460763 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e4f70-2853-41cb-a6a4-25c18d04e012 None None] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:22:51.525762 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e4f70-2853-41cb-a6a4-25c18d04e012 None None] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:22:51.529533 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d869311-a8fc-4a9d-8fbf-519548f35ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:22:51.530215 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d869311-a8fc-4a9d-8fbf-519548f35ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:22:51.530493 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d869311-a8fc-4a9d-8fbf-519548f35ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:22:51.530771 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d869311-a8fc-4a9d-8fbf-519548f35ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:22:51.532728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-0d869311-a8fc-4a9d-8fbf-519548f35ba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:22:51.546733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d869311-a8fc-4a9d-8fbf-519548f35ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:22:51.548216 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d869311-a8fc-4a9d-8fbf-519548f35ba0 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:22:51.559544 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1315/2612] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:22:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:00.440343 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=35 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:01.554351 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=26 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:01.560030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fa0f-7b1c-49e3-b5ff-8b9303336846 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:01.561573 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d0f4fa0f-7b1c-49e3-b5ff-8b9303336846 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:01.573658 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fa0f-7b1c-49e3-b5ff-8b9303336846 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:01.577848 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af2649-fd6f-4597-a9f3-67e3b174afb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:01.578441 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af2649-fd6f-4597-a9f3-67e3b174afb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:01.578717 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af2649-fd6f-4597-a9f3-67e3b174afb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:01.578984 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af2649-fd6f-4597-a9f3-67e3b174afb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:01.588663 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af2649-fd6f-4597-a9f3-67e3b174afb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:01.590082 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af2649-fd6f-4597-a9f3-67e3b174afb6 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:01.599478 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1298/2613] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:03.190170 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d869311-a8fc-4a9d-8fbf-519548f35ba0 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:03.207630 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d869311-a8fc-4a9d-8fbf-519548f35ba0 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:03.213969 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765c2a-942d-402e-b360-f968b7404c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:03.214593 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765c2a-942d-402e-b360-f968b7404c42 service nova] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:03.214869 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765c2a-942d-402e-b360-f968b7404c42 service nova] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:03.215137 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765c2a-942d-402e-b360-f968b7404c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:03.217048 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-9e765c2a-942d-402e-b360-f968b7404c42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:03.231093 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e765c2a-942d-402e-b360-f968b7404c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:03.233154 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e765c2a-942d-402e-b360-f968b7404c42 service nova] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:03.245502 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1316/2614] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:11.595528 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=6 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:13.240381 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=6 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:42.764496 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af2649-fd6f-4597-a9f3-67e3b174afb6 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:23:42.773683 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af2649-fd6f-4597-a9f3-67e3b174afb6 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:23:42.778489 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb2d0c-586f-47f1-97b0-cf65ccb9da0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:23:42.779085 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb2d0c-586f-47f1-97b0-cf65ccb9da0a service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:23:42.779357 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb2d0c-586f-47f1-97b0-cf65ccb9da0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:23:42.779623 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb2d0c-586f-47f1-97b0-cf65ccb9da0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:23:42.781974 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d6cb2d0c-586f-47f1-97b0-cf65ccb9da0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:23:42.792337 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb2d0c-586f-47f1-97b0-cf65ccb9da0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:23:42.793897 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb2d0c-586f-47f1-97b0-cf65ccb9da0a service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:23:42.802099 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1299/2615] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:23:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:23:52.798807 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=6 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:13.953008 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765c2a-942d-402e-b360-f968b7404c42 service nova] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:13.963369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765c2a-942d-402e-b360-f968b7404c42 service nova] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:13.967661 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891affcb-80ed-4495-887b-750850bf3686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:13.968462 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891affcb-80ed-4495-887b-750850bf3686 service neutron] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:13.968772 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891affcb-80ed-4495-887b-750850bf3686 service neutron] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:13.969040 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891affcb-80ed-4495-887b-750850bf3686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:13.971029 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-891affcb-80ed-4495-887b-750850bf3686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:13.981432 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891affcb-80ed-4495-887b-750850bf3686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:13.982894 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891affcb-80ed-4495-887b-750850bf3686 service neutron] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:13.991734 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1317/2616] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:25:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:25:14.085307 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb2d0c-586f-47f1-97b0-cf65ccb9da0a service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:14.094374 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb2d0c-586f-47f1-97b0-cf65ccb9da0a service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:14.098804 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b0179-7e34-4ec0-a9dc-63106147561e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '974f2acdadf14df69cbe33351ee02a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:14.099453 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b0179-7e34-4ec0-a9dc-63106147561e service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:14.099720 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b0179-7e34-4ec0-a9dc-63106147561e service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:14.099988 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b0179-7e34-4ec0-a9dc-63106147561e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:14.102038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-310b0179-7e34-4ec0-a9dc-63106147561e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:14.117724 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b0179-7e34-4ec0-a9dc-63106147561e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:14.119151 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b0179-7e34-4ec0-a9dc-63106147561e service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:14.130240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1300/2617] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:25:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:25:14.202968 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891affcb-80ed-4495-887b-750850bf3686 service neutron] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:14.204804 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-891affcb-80ed-4495-887b-750850bf3686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:14.278716 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891affcb-80ed-4495-887b-750850bf3686 service neutron] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:14.284673 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1752316-9792-4eca-80cf-f2c4fb7ddec1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:14.285294 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1752316-9792-4eca-80cf-f2c4fb7ddec1 service placement] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:14.285560 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1752316-9792-4eca-80cf-f2c4fb7ddec1 service placement] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:14.285822 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1752316-9792-4eca-80cf-f2c4fb7ddec1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:14.287867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-b1752316-9792-4eca-80cf-f2c4fb7ddec1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:14.299940 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1752316-9792-4eca-80cf-f2c4fb7ddec1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:14.301557 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1752316-9792-4eca-80cf-f2c4fb7ddec1 service placement] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:14.311575 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1318/2618] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:25:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:25:17.389794 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b0179-7e34-4ec0-a9dc-63106147561e service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:17.403292 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b0179-7e34-4ec0-a9dc-63106147561e service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:17.409032 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845e582-988c-4513-a68a-5151e69b924d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:17.409650 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e582-988c-4513-a68a-5151e69b924d service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:17.409923 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e582-988c-4513-a68a-5151e69b924d service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:17.410192 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e582-988c-4513-a68a-5151e69b924d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:17.412188 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f845e582-988c-4513-a68a-5151e69b924d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:17.425396 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845e582-988c-4513-a68a-5151e69b924d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:17.427019 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845e582-988c-4513-a68a-5151e69b924d service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:17.438653 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1301/2619] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:25:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:25:24.307338 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=38 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:27.433514 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=12 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:45.329516 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1752316-9792-4eca-80cf-f2c4fb7ddec1 service placement] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:25:45.345031 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1752316-9792-4eca-80cf-f2c4fb7ddec1 service placement] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:25:45.353683 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c35492-7284-45b9-9624-6032ac053a73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:25:45.354306 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c35492-7284-45b9-9624-6032ac053a73 service placement] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:25:45.354605 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c35492-7284-45b9-9624-6032ac053a73 service placement] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:25:45.354854 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c35492-7284-45b9-9624-6032ac053a73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:25:45.357329 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-e7c35492-7284-45b9-9624-6032ac053a73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:25:45.369885 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c35492-7284-45b9-9624-6032ac053a73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:25:45.371529 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c35492-7284-45b9-9624-6032ac053a73 service placement] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:25:45.382041 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1319/2620] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:25:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:25:55.377733 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=6 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:38.906767 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845e582-988c-4513-a68a-5151e69b924d service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:26:38.908567 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f845e582-988c-4513-a68a-5151e69b924d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:26:38.925463 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845e582-988c-4513-a68a-5151e69b924d service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:26:38.933618 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707bcb-0e75-4b9d-9bd4-f6c7d21c429e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66e6f6ea62d439c87d9551286d29615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:26:38.934233 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707bcb-0e75-4b9d-9bd4-f6c7d21c429e service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:26:38.934509 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707bcb-0e75-4b9d-9bd4-f6c7d21c429e service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:26:38.934777 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707bcb-0e75-4b9d-9bd4-f6c7d21c429e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:26:38.937295 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-01707bcb-0e75-4b9d-9bd4-f6c7d21c429e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:26:38.950668 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707bcb-0e75-4b9d-9bd4-f6c7d21c429e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:26:38.952596 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707bcb-0e75-4b9d-9bd4-f6c7d21c429e service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:26:38.977744 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1302/2621] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:26:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:26:44.477794 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c35492-7284-45b9-9624-6032ac053a73 service placement] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:26:44.488803 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c35492-7284-45b9-9624-6032ac053a73 service placement] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:26:44.494164 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4bc7-4765-4773-955a-06801643bd7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:26:44.494845 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4bc7-4765-4773-955a-06801643bd7f service placement] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:26:44.495188 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4bc7-4765-4773-955a-06801643bd7f service placement] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:26:44.495509 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4bc7-4765-4773-955a-06801643bd7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:26:44.497504 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-07ef4bc7-4765-4773-955a-06801643bd7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:26:44.509118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef4bc7-4765-4773-955a-06801643bd7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:26:44.510707 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef4bc7-4765-4773-955a-06801643bd7f service placement] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:26:44.521876 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1320/2622] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:26:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:26:47.643092 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707bcb-0e75-4b9d-9bd4-f6c7d21c429e service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:26:47.654990 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707bcb-0e75-4b9d-9bd4-f6c7d21c429e service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:26:47.660030 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92995cb4-4a3c-42ae-a906-14e92566c7b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:26:47.660689 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92995cb4-4a3c-42ae-a906-14e92566c7b6 service placement] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:26:47.660970 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92995cb4-4a3c-42ae-a906-14e92566c7b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:26:47.661246 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92995cb4-4a3c-42ae-a906-14e92566c7b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:26:47.663016 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-92995cb4-4a3c-42ae-a906-14e92566c7b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:26:47.674849 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92995cb4-4a3c-42ae-a906-14e92566c7b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:26:47.677475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92995cb4-4a3c-42ae-a906-14e92566c7b6 service placement] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:26:47.686778 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1303/2623] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:26:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:26:47.715162 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4bc7-4765-4773-955a-06801643bd7f service placement] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:26:47.786585 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4bc7-4765-4773-955a-06801643bd7f service placement] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:26:47.792132 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:26:47.792844 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:26:47.793118 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:26:47.793382 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] PATH_INFO: `/v3/users/ab1533f90ee04e009967a27e84beaaf4` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:26:47.794743 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1533f90ee04e009967a27e84beaaf4)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:26:47.796634 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:26:47.848651 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1533f90ee04e009967a27e84beaaf4'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:47.862135 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1533f90ee04e009967a27e84beaaf4'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:47.862973 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1533f90ee04e009967a27e84beaaf4'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:47.875868 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1533f90ee04e009967a27e84beaaf4'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:47.876667 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1533f90ee04e009967a27e84beaaf4'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:47.890437 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1321/2624] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:26:47 2022] DELETE /identity/v3/users/ab1533f90ee04e009967a27e84beaaf4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:26:48.068672 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92995cb4-4a3c-42ae-a906-14e92566c7b6 service placement] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:26:48.085269 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92995cb4-4a3c-42ae-a906-14e92566c7b6 service placement] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:26:48.147296 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:26:48.147927 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:26:48.148203 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:26:48.148504 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] PATH_INFO: `/v3/projects/336ab415ef6348a5a2e86beb90b8d853` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:26:48.149692 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=336ab415ef6348a5a2e86beb90b8d853)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:26:48.151595 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:26:48.197766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336ab415ef6348a5a2e86beb90b8d853', 'request_id': 'req-e35c279e-b3aa-452d-84df-254606e52719'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.205743 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336ab415ef6348a5a2e86beb90b8d853', 'request_id': 'req-e35c279e-b3aa-452d-84df-254606e52719'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.212038 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336ab415ef6348a5a2e86beb90b8d853', 'request_id': 'req-e35c279e-b3aa-452d-84df-254606e52719'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.222733 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] The token cache is being invalidate because project 336ab415ef6348a5a2e86beb90b8d853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:26:48.223047 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.223674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.225194 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1304/2625] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:26:48 2022] DELETE /identity/v3/projects/336ab415ef6348a5a2e86beb90b8d853 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:26:48.229474 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:26:48.230947 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:26:48.244269 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac235b2f-c290-4ee9-8a34-7a2268bbc3c2 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:26:48.300773 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:26:48.301392 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:26:48.301666 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:26:48.301932 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] PATH_INFO: `/v3/users/6343f166a3de4f8e88312a4935345593` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:26:48.303080 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6343f166a3de4f8e88312a4935345593)` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:26:48.305042 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:26:48.310571 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:48.355195 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6343f166a3de4f8e88312a4935345593'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.362350 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6343f166a3de4f8e88312a4935345593'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.363017 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6343f166a3de4f8e88312a4935345593'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.374858 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6343f166a3de4f8e88312a4935345593'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.375490 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.notifications [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6343f166a3de4f8e88312a4935345593'} {{(pid=81636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.389506 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1322/2626] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Oct 24 13:26:48 2022] DELETE /identity/v3/users/6343f166a3de4f8e88312a4935345593 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:26:48.578218 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:26:48.579766 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:26:48.593409 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c279e-b3aa-452d-84df-254606e52719 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:26:48.652475 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a57e5ee78334c3d8abcf656f9c79512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137e4bed4da241048e2ccc51fb5ebefa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:26:48.653240 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:26:48.653527 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:26:48.653800 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] PATH_INFO: `/v3/projects/fda0afea3d42458eb2ab9703c2b845b3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:26:48.654958 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda0afea3d42458eb2ab9703c2b845b3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:26:48.656966 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:26:48.663867 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:48.707457 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda0afea3d42458eb2ab9703c2b845b3', 'request_id': 'req-c09f13f3-f969-4a21-8e76-0a889ea6606d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.715288 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda0afea3d42458eb2ab9703c2b845b3', 'request_id': 'req-c09f13f3-f969-4a21-8e76-0a889ea6606d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.721760 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda0afea3d42458eb2ab9703c2b845b3', 'request_id': 'req-c09f13f3-f969-4a21-8e76-0a889ea6606d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.732922 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] The token cache is being invalidate because project fda0afea3d42458eb2ab9703c2b845b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 13:26:48.733212 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.733864 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-c09f13f3-f969-4a21-8e76-0a889ea6606d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 13:26:48.735890 dv-cinder-862489-1-smb devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1305/2627] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Oct 24 13:26:48 2022] DELETE /identity/v3/projects/fda0afea3d42458eb2ab9703c2b845b3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 13:26:58.386203 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:58.729674 dv-cinder-862489-1-smb devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:51.301907 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] Authenticating user token {{(pid=81636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 13:30:51.303469 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:51.449284 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efa7fb-ed11-440d-8504-ab4f2e659b04 admin admin] Validating token access rules against request {{(pid=81636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 13:30:51.510965 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1429b-b6a9-4101-9357-219c8ad9c4ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a25b60f83d84fb38a759d6620c1c58c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f24d177141b44fbca74b3aa6878becf9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 13:30:51.511587 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1429b-b6a9-4101-9357-219c8ad9c4ff service placement] REQUEST_METHOD: `GET` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 13:30:51.511867 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1429b-b6a9-4101-9357-219c8ad9c4ff service placement] SCRIPT_NAME: `/identity` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 13:30:51.512138 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1429b-b6a9-4101-9357-219c8ad9c4ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 13:30:51.513958 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.fernet_utils [None req-62b1429b-b6a9-4101-9357-219c8ad9c4ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 13:30:51.525765 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1429b-b6a9-4101-9357-219c8ad9c4ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 13:30:51.527369 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1429b-b6a9-4101-9357-219c8ad9c4ff service placement] RBAC: Authorization granted {{(pid=81636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 13:30:51.537897 dv-cinder-862489-1-smb devstack@keystone.service[81636]: [pid: 81636|app: 0|req: 1323/2628] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Oct 24 13:30:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 13:31:01.533728 dv-cinder-862489-1-smb devstack@keystone.service[81636]: DEBUG dbcounter [-] [81636] Writing DB stats keystone:SELECT=89 {{(pid=81636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}